-- Logs begin at Mon 2022-07-11 19:31:01 UTC, end at Mon 2022-07-11 20:15:29 UTC. -- Jul 11 20:00:42.582358 dv-cinder-849022-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 20:00:42.592651 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 20:00:42 2022] *** Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: nodename: dv-cinder-849022-1-iscsi Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: machine: x86_64 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: clock source: unix Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: pcre jit disabled Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: detected number of CPU cores: 4 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: current working directory: / Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: detected binary path: /usr/bin/uwsgi-core Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: your processes number limit is 47680 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: your memory page size is 4096 bytes Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: detected max file descriptor number: 2048 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: lock engine: pthread robust mutexes Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: thunder lock: enabled Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 20:00:42.594760 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 20:00:42.636825 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: Python main interpreter initialized at 0x55cfff6979c0 Jul 11 20:00:42.636825 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: python threads support enabled Jul 11 20:00:42.636825 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: your server socket listen backlog is limited to 100 connections Jul 11 20:00:42.636825 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: your mercy for graceful operations on workers is 90 seconds Jul 11 20:00:42.637186 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 20:00:42.637260 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: *** Operational MODE: preforking *** Jul 11 20:00:42.637513 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: *** uWSGI is running in multiple interpreter mode *** Jul 11 20:00:42.637513 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: spawned uWSGI master process (pid: 80487) Jul 11 20:00:42.637730 dv-cinder-849022-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 11 20:00:42.638873 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: spawned uWSGI worker 1 (pid: 80498, cores: 1) Jul 11 20:00:42.638873 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: spawned uWSGI worker 2 (pid: 80499, cores: 1) Jul 11 20:00:42.638873 dv-cinder-849022-1-iscsi devstack@keystone.service[80487]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 20:00:47.984538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:00:47.984538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jul 11 20:00:47.985353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:00:47.985353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: from cryptography.utils import int_from_bytes Jul 11 20:00:47.985760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:00:47.985760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jul 11 20:00:47.985869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:00:47.985869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: from cryptography.utils import int_from_bytes Jul 11 20:00:48.033509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:00:48.033690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:00:48.033771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:00:48.033918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] command line args: [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:00:48.034099 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:00:48.034099 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] command line args: [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:00:48.034253 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:00:48.034387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:00:48.034466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ================================================================================ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:00:48.034630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ================================================================================ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:00:48.034761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] admin_token = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.034847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.034915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_dir = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_dir = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_source = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] debug = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_source = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] debug = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.035937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036088 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036274 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.036994 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_config_append = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_config_append = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_dir = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_dir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037582 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037708 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.037785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.038872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039500 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039594 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.039980 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.040922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] publish_errors = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] publish_errors = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.041912 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042055 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.042929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043180 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] standard_threads = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] standard_threads = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043468 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.043969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_journal = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_journal = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_json = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_json = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_stderr = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044651 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_stderr = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_syslog = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_syslog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.044946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:00:48.045014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045532 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.045902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046704 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.046872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.047969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048050 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.048934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.049748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050773 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.050998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051792 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.051956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052249 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052470 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.052958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.053926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.054859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055249 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055580 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.055969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056047 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.056916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.057729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058637 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058718 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.058949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059115 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.059901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.060852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061008 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061086 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061272 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061348 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.061988 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.062965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063278 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.063982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.064916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.065964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.066998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.067917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068153 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.068962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069137 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069676 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.external = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.069986 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.external = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070454 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070569 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.password = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.070998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.password = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.token = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.token = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.071930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072646 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.072875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073514 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073594 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.073992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.074994 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.075998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.076990 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077068 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.077938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078518 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.078999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.079961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080127 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080449 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080840 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.080918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081625 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.081873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.082845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083746 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.083991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.084982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.085946 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086106 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086479 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.086982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087481 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.087983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.088985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089233 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.089896 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090291 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.090915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.091943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.092950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093469 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.093953 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.094990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095114 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.095998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096630 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.096878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097130 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097626 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.097882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098480 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098626 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098695 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.098988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099133 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099637 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.099931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.100920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.101888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102774 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.102851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.103981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104311 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.104956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105503 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.105990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.106890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107786 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.107864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108518 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.108851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109002 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109692 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.109939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110298 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.110935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111630 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.111951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.112918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.113870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114025 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.114990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.115858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.116988 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117533 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.117929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118186 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.118989 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.119933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.120081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.120158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:00:48.120251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:00:48.120328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:00:48.150958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.151136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.151272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.151351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.151415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.151557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.159964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.160056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.187821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.188046 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.188169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.188329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.329492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.329877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.377403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.377646 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.377799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.378006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.440689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.440898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441114 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.441926 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.442134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.442134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.466655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.466835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.467081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.467331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.467555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.467746 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.467988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.469144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.469419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.469672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.469931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.470308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.470609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.470891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.479327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.481717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492747 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.492890 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.493722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.494003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:00:48.510835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.511053 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:00:48.511357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.511482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.511581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:00:48.511650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:00:48.511803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.511889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:00:48.512206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.512782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.513062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.523409 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.523686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.523914 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.524039 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.524235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.524423 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.524515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.524714 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.532477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.532961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.535772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.536052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.536174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.536325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.536449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.536638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.536724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.536863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.537959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.538841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.565100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.565396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.566720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.567000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.567195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.567289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.572267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.572548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.572670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.572919 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.573028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.573227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.580266 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.580474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.580599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.580799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.584997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.585248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.585376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.585575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.585756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.585849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.585971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.586915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.587131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.605329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.605530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.605653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.605779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.610177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.610491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.613785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.614078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.614175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.614497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.619277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.619662 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.622901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.623268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.626544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.626840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.626965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.627942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.628032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.628258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.647102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.647255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.647346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.647559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.647701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.647835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.647915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.648031 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.655729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.655938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.657430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.657593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.657683 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.657851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.660880 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.661023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.661160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.661240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.661428 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.661565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.661715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.661798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.662054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.662178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.675327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.675475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.675613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.675702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.675866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.675989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.676137 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.676219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.676424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.677669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.677969 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.678143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.678260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.678343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.696478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.696603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.699755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.699880 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.703052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.703177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.704783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.704932 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.706419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.706547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.706743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.706866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.707001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.707097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.714321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.714446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.715911 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.716034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.719154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.719283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.719417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.719496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.719818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.719941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.720093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.720175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.729167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.729292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.729422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.729522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.729717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.729842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.737564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.737689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:00:48.737835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.737920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.738775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739691 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.739962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.740880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.741018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.741140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.741230 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:00:48.778560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfff6979c0 pid: 80499 (default app) Jul 11 20:00:48.778686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfff6979c0 pid: 80498 (default app) Jul 11 20:00:48.781931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f02c0-af41-4ebd-8bea-89f7c59f77c9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:48.782252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f02c0-af41-4ebd-8bea-89f7c59f77c9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:48.782531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f02c0-af41-4ebd-8bea-89f7c59f77c9 None None] PATH_INFO: `/v3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:48.786843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Jul 11 20:00:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:00:56.427659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:56.428601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:56.428601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:56.436236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:00:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:00:56.442786 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:56.443220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:56.443367 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:56.511888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: INFO dbcounter [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] Registered counter for database keystone Jul 11 20:00:56.536926 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG oslo_db.sqlalchemy.engines [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:00:56.548723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writer thread running {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:00:56.730581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG passlib.handlers.bcrypt [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80499) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 20:00:56.730977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG passlib.handlers.bcrypt [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80499) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 20:00:56.786055 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:00:56.787764 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:00:56.925829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:00:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 20:00:56.998857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:00:57.071791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: INFO dbcounter [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] Registered counter for database keystone Jul 11 20:00:57.093336 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:00:57.103889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writer thread running {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:00:57.225126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c76861-7041-453c-a25d-f3b2866743e7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:00:57.230760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:00:57.231438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:57.231716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:57.231992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:57.241246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:00:57.292101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 20:00:57.292377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497176-7515-4b61-8f02-efad5ec762ab admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:00:57.302568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 11 20:00:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 20:00:57.312929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:00:57.335822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310a6d-69df-42e9-9a9d-d283fae9fa7f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:00:57.341334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:00:57.342523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:57.342815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:57.343097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] PATH_INFO: `/v3/projects/baf222b77c1c4150a568d9f632f18818` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:57.347549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=baf222b77c1c4150a568d9f632f18818)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:00:57.397615 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 20:00:57.397964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc664df-b419-478e-930b-f90dfe0e69c1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:00:57.402700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Jul 11 20:00:57 2022] GET /identity/v3/projects/baf222b77c1c4150a568d9f632f18818 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:00:59.441544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58355e7-444a-4664-8185-b73c57d77276 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:59.442452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58355e7-444a-4664-8185-b73c57d77276 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:59.442452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58355e7-444a-4664-8185-b73c57d77276 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:59.447369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:00:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:00:59.455261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:59.455667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:59.455818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:59.477577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:00:59.479174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:00:59.488294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:00:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 20:00:59.511173 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58355e7-444a-4664-8185-b73c57d77276 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:00:59.531405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58355e7-444a-4664-8185-b73c57d77276 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:00:59.539751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:00:59.540395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:59.540692 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:59.540965 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:59.550447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:00:59.552257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9626b-a0e9-45cd-8ccc-728b2112b4af admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:00:59.562408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 11 20:00:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 20:00:59.571541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:00:59.585516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5648888-bc53-4b9a-9bd0-62caed599b42 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:00:59.590763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:00:59.591642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:00:59.591927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:00:59.592201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:00:59.593952 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:00:59.595826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45c310-528e-4bc6-bc3f-6091d10f4acd admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:00:59.597419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Jul 11 20:00:59 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:01.657075 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4671-635d-4bfc-8879-a721ad312579 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:01.657602 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4671-635d-4bfc-8879-a721ad312579 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:01.657705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4671-635d-4bfc-8879-a721ad312579 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:01.659188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:01.664624 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:01.665052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:01.665143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:01.682158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:01.683653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:01.736065 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c357-8828-4ee2-bd3f-53bbe7c830cd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:01.736327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c357-8828-4ee2-bd3f-53bbe7c830cd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:01.736609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c357-8828-4ee2-bd3f-53bbe7c830cd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:01.737979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:01.743120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:01.743413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:01.743693 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:01.767151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:01.784723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80498) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 20:01:01.785165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80498) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 20:01:01.790401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:01.815957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:01.830544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:01.832294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:01.896886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25df63-488f-4b4f-9bbb-f689d55502df None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:01.929839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:01.930657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:01.930919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:01.931198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:01.935118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:01.943627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:01.955150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:01.956082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:01.956895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:01.957574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:01.962416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.046211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.058210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4abc9e-7806-42aa-9a80-ce7d269de36f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.060477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.064856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7baa-81f7-4ef3-8349-2752660c88ac None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.095721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.096649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.096940 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.097226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.098412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.099087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.099378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.099657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.100612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:02.101647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.103113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.116197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:02.121529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.165105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.166697 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.219901 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94e50-f33c-4aae-a7a3-891c57b51028 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.253721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.254618 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.254904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.255179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.256441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.257909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.259789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:02 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:02.265036 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.266189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:01:02.271684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.274383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.279252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.363283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfb7f-d1c7-48d0-99b9-f9adc271c91c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.369198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dd3f-df84-4ed2-a878-e8ed2e567bdc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.397463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.398392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.398678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.398952 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.400140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.401621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.401962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.402790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.403073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.403255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:02.403375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.408945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.422067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.423566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:01:02.447162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:02.448015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:02.448803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:01:02.448803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:01:02.448803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:01:02.448803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:02.448803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:02.454149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:02.489282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.508647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f8db-4e4d-4809-81eb-7b79e5ee3aff None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.509871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:02.542550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.543212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.543497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.543773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.544610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.domain.id=default, user.id=e6037ad69919420ab0fb4e92ad544513) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:02.544921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.546410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def6c37-4ca7-4741-bc03-7083d2612160 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.552504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53b34-6223-4861-8f2d-8e5220ca191a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:02.553229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 11 20:01:02 2022] GET /identity/v3/role_assignments?user.id=e6037ad69919420ab0fb4e92ad544513&scope.domain.id=default&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:02.588737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:02.589431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:02.589715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:02.589994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:02.590775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:02.591081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:02.592519 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4922-3026-4569-b6e9-9d4a8d7c247f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:02.612781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:05.132815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe6f2-01c6-4449-b99c-2c00cf813371 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.133810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe6f2-01c6-4449-b99c-2c00cf813371 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.134339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe6f2-01c6-4449-b99c-2c00cf813371 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.135930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:05.141384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338915-7941-4db8-a251-e2378d2b86ec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.142207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338915-7941-4db8-a251-e2378d2b86ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.142694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338915-7941-4db8-a251-e2378d2b86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.163402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a3338915-7941-4db8-a251-e2378d2b86ec None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:05.164916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a3338915-7941-4db8-a251-e2378d2b86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:05.181348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98e6c-400c-41ac-8a50-fe9da2be1dbf None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.181933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98e6c-400c-41ac-8a50-fe9da2be1dbf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.182416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98e6c-400c-41ac-8a50-fe9da2be1dbf None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.184305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:05.189518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.190061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.190527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.223574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:05.226225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:05.309218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:05.310915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb1f3-a1a4-4ffb-a2de-0a15e38e9570 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.318885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb1f3-a1a4-4ffb-a2de-0a15e38e9570 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.320681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb1f3-a1a4-4ffb-a2de-0a15e38e9570 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.324807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 12/25] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:05.328152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.328655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.329132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.366059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:05.368934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:05.374932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:05.389745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:05.457942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:05.487837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:05.493030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:05.493030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:05.538670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f2c1a-da10-41bc-af33-6cfe97c5575a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:05.578963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:05.580038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.580327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.580607 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.595733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:05.597807 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:05.619621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14024-0bbf-4261-b8d5-7373f1c61460 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-cd279a92-2a5d-45d4-b7bc-eee12deac29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:01:05.623858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:05.624670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:05.625444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:01:05.625444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:01:05.625444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:01:05.625444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:05.625444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 15/28] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:05.626399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca2c2-2429-42a0-bdeb-830ca286b5f5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.626689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca2c2-2429-42a0-bdeb-830ca286b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.626968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca2c2-2429-42a0-bdeb-830ca286b5f5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.633013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 16/29] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:05.633825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ca2c2-2429-42a0-bdeb-830ca286b5f5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:05.661322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:05.662626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.663131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.663606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.675833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:05.685435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:05.686546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:05.687281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:05.694800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:05.695915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:05.733612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:05.768342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ca2c2-2429-42a0-bdeb-830ca286b5f5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:05.802492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1940916-a4ab-4f25-9e54-cf84b98eb5b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:05.802755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:05.817840 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:05.818830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.819256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.819674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.821049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:05.825492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:05.851700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:05.852529 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.852907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.853280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.854169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:05.854620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:05.856153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be708ff6-1253-4656-90a1-8d400e27e82e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:05.869392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:05.870933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:05.871322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:05.871770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:05.889559 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:05.891058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:05.967228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:05.968283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:05.986296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 17/33] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:05.992754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.018706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.105459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b031f-08da-460a-8527-0780c82f6a19 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.114548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1cbcf-d83f-448b-af75-a2625eb08d6f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.145478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.146820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.147275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.147730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.148503 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:06.148957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.150556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.150928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.151621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.151909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.152192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.152918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.154552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6318d-2e22-4365-bc3c-c1d7191d40c3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.167481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:06.168579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.191028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:01:05 2022] POST /identity/v3/projects => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:06.192932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4a97-cc5c-4d18-87c5-885b58462ef1 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.193419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4a97-cc5c-4d18-87c5-885b58462ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.194021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4a97-cc5c-4d18-87c5-885b58462ef1 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.195594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:06.196569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4a97-cc5c-4d18-87c5-885b58462ef1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.261310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.293849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.309723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec542-b411-433c-8ba8-331e9d4507cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.347143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4a97-cc5c-4d18-87c5-885b58462ef1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.348190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.348893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.349227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.349514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.350482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.352093 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.391701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.392974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.393524 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.393990 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.395555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.397297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eafd0-80fd-4f73-b89c-50c09f0fc514 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.399653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 20/37] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:06 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:06.401526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a878e6-7085-47e5-a838-886f33089ef1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.402019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a878e6-7085-47e5-a838-886f33089ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.402654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a878e6-7085-47e5-a838-886f33089ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.421599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-19a878e6-7085-47e5-a838-886f33089ef1 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:06.423663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-19a878e6-7085-47e5-a838-886f33089ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:06.484079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 18/38] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 11 20:01:06 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:06.485077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.502932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:06.504142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca847f9-150c-4031-a58c-2bc443a9a3d4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.504434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca847f9-150c-4031-a58c-2bc443a9a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.504711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca847f9-150c-4031-a58c-2bc443a9a3d4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.506373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 22/40] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:06.513147 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.513598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.513598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.532945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:06.534265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:06.568299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.614089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15e6e9-b816-4e68-8f65-06e3b1b91583 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.616159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:06.616858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.657637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.658559 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.658849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.659130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.660681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.663013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.664273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 19/42] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:06.664817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.687716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.782521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfca5-c013-4642-8500-de22cba30136 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.817564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.818446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.818728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.819089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.820298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.821778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.823642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 20/43] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:06.824195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.849688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720027d-4f75-4077-906d-e130de91eb99 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.883119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.883799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.884088 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.884363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.885115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.886555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.900557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 24/44] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 11 20:01:06 2022] POST /identity/v3/roles => generated 223 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:06.902066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:06.907881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.926543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634640-40a2-4c72-b2ed-83fb3d500b06 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:06.937940 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:06.966807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:06.967720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:06.968024 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:06.968309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] PATH_INFO: `/v3/domains/default/users/e6037ad69919420ab0fb4e92ad544513/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:06.970903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e6037ad69919420ab0fb4e92ad544513, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:06.972406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d965ac-15a7-483c-ace8-6a6292d66690 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:06.990297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 21/45] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Jul 11 20:01:06 2022] PUT /identity/v3/domains/default/users/e6037ad69919420ab0fb4e92ad544513/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:07.031595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66b5d-a10a-46ef-a71a-dcc543735589 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:07.072907 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:07.073517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:07.073802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:07.074103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:07.074850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:07.076356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cb112-1c63-4f93-bffd-ac3f5ddd6172 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:07.106515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:01:06 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:09.007641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d40f-271b-42d1-8c5b-711f34344736 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.008197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d40f-271b-42d1-8c5b-711f34344736 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.008197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d40f-271b-42d1-8c5b-711f34344736 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.009577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:09.014792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda1b9-8869-4700-a306-da6985578aed None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.015209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda1b9-8869-4700-a306-da6985578aed None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.015351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfda1b9-8869-4700-a306-da6985578aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.032568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cbfda1b9-8869-4700-a306-da6985578aed None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:09.033769 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cbfda1b9-8869-4700-a306-da6985578aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:09.100608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455df2-534f-4557-a484-ef66f0338596 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.100795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455df2-534f-4557-a484-ef66f0338596 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.101112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455df2-534f-4557-a484-ef66f0338596 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.101751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:09.102562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 23/49] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:09.107771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.108058 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.108333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.124366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455df2-534f-4557-a484-ef66f0338596 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.124672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:09.125841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:09.127831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:09.194716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 27/50] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:09.217729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.229511 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455df2-534f-4557-a484-ef66f0338596 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.263579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.264369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.264656 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.264936 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.275369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:09.283180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:09.284006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:09.284793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 24/51] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:09.290427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.294898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:09.320460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6f8a8-2480-4aa0-947b-773bf67d8240 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.357629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.359025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.359320 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.359597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.360954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:09.362482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:09.364149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 28/52] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:09.369974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.378692 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:09.394926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db61be-b8ef-4476-9d8e-68d1288926cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.429173 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.429826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.430153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.430439 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.431213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:09.431532 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:09.433262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:09.441340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 25/53] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:09.446971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.469883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9284-7a3f-4351-866f-0020da9e506c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.504849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.505526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.505816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.506203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.506937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:09.508413 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:09.512787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:09.538766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 29/54] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 11 20:01:09 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:09.556094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f40af-1a7d-49c7-80f2-f9a14822ccef None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.592970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.593884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.594198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.594481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:09.597327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:09.599045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 26/55] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:09.604854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.668131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:09.714491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae004-9762-40ba-a843-9e1b3972dc4d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:09.747946 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:09.748760 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:09.749047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:09.749325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:09.750547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:09.752009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745998dd-b03b-4be5-9a6a-abb654b34188 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:09.753651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 30/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:09.759672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:09.972675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357884-e2e9-4793-8366-e6e28c89827d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:10.008132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:10.008777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:10.009090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:10.009368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:10.010254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.domain.id=default, user.id=e6037ad69919420ab0fb4e92ad544513) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:10.010573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:10.012028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a427-3d87-46bb-952f-dce1b8fa916c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:10.014345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:10.021415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 27/57] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 11 20:01:09 2022] GET /identity/v3/role_assignments?user.id=e6037ad69919420ab0fb4e92ad544513&scope.domain.id=default&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 530 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:11.560085 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d25d7-4430-4dcd-b227-45de99af282d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:11.560608 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d25d7-4430-4dcd-b227-45de99af282d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:11.560608 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d25d7-4430-4dcd-b227-45de99af282d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:11.562774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 31/58] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:11.567976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:11.568387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:11.568549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:11.587948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:11.589498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:11.658988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:11.683718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d25d7-4430-4dcd-b227-45de99af282d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:11.794027 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d25d7-4430-4dcd-b227-45de99af282d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:11.820721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:11.831392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:11.832216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:11.832499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:11.832777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:11.834020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:11.835620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a565-72ec-4543-a672-f53996aabe23 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:11.837250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 32/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:11.842790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:11.958935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452a2ea-9078-4ac4-b288-da907f3be161 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:11.985523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:11.999933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:12.000947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:12.001353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:12.001731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:12.002903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:12.005212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae588f9-8e26-4833-b256-6de5ab1d2e56 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:12.033661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 29/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:11 2022] POST /identity/v3/users => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:15.052756 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947242b-c19b-4bab-b566-b36214cf4a3b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.053814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947242b-c19b-4bab-b566-b36214cf4a3b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.054324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947242b-c19b-4bab-b566-b36214cf4a3b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.055904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 33/62] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:15.061635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.062483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.062979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.088631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:15.090334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:15.114848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccd2e-41ae-4343-9210-d94c9bb8f57b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.115494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccd2e-41ae-4343-9210-d94c9bb8f57b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.115992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cccd2e-41ae-4343-9210-d94c9bb8f57b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.117566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 34/63] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:15.122662 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.123167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.123643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.155152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:15.157513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:15.198064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 30/64] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:15.221654 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.269490 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:15.291535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.383063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7a3ec-7df5-4b88-8178-55d5f8b61794 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.398953 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:15.430703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.431988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.432564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.433553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.441564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e07a6f-f846-4051-9bc4-8978940cad9b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.447816 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-41bbbf01-1e78-4cd9-a4d8-76793718b5fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:15.456141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:15.457170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:15.457999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:15.458627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 31/66] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:15.459921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad4859-8f47-4a8b-8bcb-8eb3282369ee None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.460341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad4859-8f47-4a8b-8bcb-8eb3282369ee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.460736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad4859-8f47-4a8b-8bcb-8eb3282369ee None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.462411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 32/67] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:15.464291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad4859-8f47-4a8b-8bcb-8eb3282369ee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.477960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:15.491874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.492515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.492803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.493082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.503924 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e9e408fe-6ab2-407f-a75a-5e98d2b073ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:15.512133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:15.512971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:15.513749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 36/68] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:15.518558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.518558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.518558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.536300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:15.537604 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:15.588337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad4859-8f47-4a8b-8bcb-8eb3282369ee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.606803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:15.607651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.625245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.626296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.626771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.627274 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.628209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:15.628714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:15.630420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:15.640740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 33/70] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:15.647066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.690894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:15.756964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93441750-7b5e-41bc-a5ca-1d75d8cfeeb7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.760300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5514-f53e-417f-a04a-bd2f32f84d0d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.772449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:15.794250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.794994 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.795274 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.795556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.796323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:15.796637 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:15.798091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:15.800950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a923d-860c-4595-86d3-964176405de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.801839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a923d-860c-4595-86d3-964176405de9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.802157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a923d-860c-4595-86d3-964176405de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.802444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a923d-860c-4595-86d3-964176405de9 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.811128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:15.811128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.821073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a923d-860c-4595-86d3-964176405de9 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:15.823005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a923d-860c-4595-86d3-964176405de9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:15.829098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:15.829098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e71cb-506f-46c7-b105-e66d05e87f99 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.829098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e71cb-506f-46c7-b105-e66d05e87f99 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.829098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e71cb-506f-46c7-b105-e66d05e87f99 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.829098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 35/73] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:15.833836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e71cb-506f-46c7-b105-e66d05e87f99 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.918660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbbe8-bdc1-4ab0-99eb-a7f62ed9d5a4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.938142 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:15.947245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e71cb-506f-46c7-b105-e66d05e87f99 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:15.958443 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.959393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.959640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.959925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.971335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:15.979116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:15.979959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:15.980696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 39/74] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:15.985842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:15.985947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:15.986839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.987119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.987393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:15.988603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:15.990103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b47778-542a-49b8-9204-a9f70699e733 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:15.991916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 36/75] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:15.992917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58e836-f432-4282-88d0-025d6c8fd4c0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:15.993200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58e836-f432-4282-88d0-025d6c8fd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:15.993477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58e836-f432-4282-88d0-025d6c8fd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.009154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bb58e836-f432-4282-88d0-025d6c8fd4c0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:16.010355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb58e836-f432-4282-88d0-025d6c8fd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:16.016378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.077171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 37/76] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:16.078537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7443-122c-4ec9-b139-08c620df60ed None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.078828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7443-122c-4ec9-b139-08c620df60ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.079102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c7443-122c-4ec9-b139-08c620df60ed None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.081112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 38/77] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:16.081960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c7443-122c-4ec9-b139-08c620df60ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.092451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ce0-2278-4527-a4d1-080229b2a6eb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.131528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.132173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.132451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.132724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.179916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.189575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c7443-122c-4ec9-b139-08c620df60ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.199466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.200937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c888e-6919-4890-89c7-c3caf54f3001 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.223956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.224663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.224949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.225238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.226003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:16.226362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.227779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.233850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.235917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.236741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.302123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 40/79] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:16.303462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.303751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.304033 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.320198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:16.321411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:16.336874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba7aee-c5d7-4bf8-8bb0-265aba840049 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.369101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.369766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.370076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.370362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.387569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:16.388475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.408705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.452766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.453247 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.454259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.489872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006a16-6ae5-4144-8c88-97420e1b16c8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.524124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.524942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.525229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.525507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.535600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:16.543344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:16.544195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:16.544957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:16.545588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.560593 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:16.561451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.615894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.649846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae000b9-eda3-4310-9dc7-49699247dab0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.660737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948396d-6336-45ec-9479-a58abc41fc26 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.674674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.683758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.684657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.684941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.685199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.686437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.687912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.689557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.690346 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.694836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.695761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.696046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.696321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.697633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.699127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.700844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.702147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.791030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b65e-65a8-4127-b750-4c0061df69fb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.798847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1acfd-762a-47b7-80ab-31f6542883eb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.821865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.828285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.829104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.829485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.829768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.830997 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.832442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.834105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 44/85] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.834899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.835013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.835635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.835917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.836190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.836940 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:16.837252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.838672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.847070 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.847854 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.897541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:16.936932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ae65e-eb59-48eb-ac78-753db0c8cd40 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.946534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73232a3-e039-456b-9cb3-2d668ed7f92a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:16.969305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.970195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.970477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.970749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:16.971943 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:16.973396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:16.975177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:16.975928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:16.980148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:16.980814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:16.981132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:16.981413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.031381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.046843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.048283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.077113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3c911-0691-428c-844b-6f990f7b4233 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.104090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.110273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.110930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.111220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.111501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.112343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:17.112661 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.114141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.119588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 46/88] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:17.120347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.150177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 43/89] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:17.151666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.242827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.253325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714d3d-d1b7-4242-a630-415e4c6e7d1f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.261517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffe4ab-461b-49c0-930c-02078a16c242 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.294178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.294871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.295219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.295508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.296276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.297808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.300289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.301385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.301838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.302310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.303712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.305332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.307492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:17.308741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.325857 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 47/91] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:17 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:17.327038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.399288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.433396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68dd9b-251e-4378-96d5-8d80bbaadd25 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.475270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.475961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.476245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.476534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.477403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:17.477722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.478364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8875-7ae1-4bb5-9fda-3ef3a787bd0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.479368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.491919 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:17.493426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.519080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.526547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.528090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.528377 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.528659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.530343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.532082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.534678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:17.541048 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:17.640191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6be4-a836-4fb8-b611-d62ccb2b67ac None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.686655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd9f2-9b26-4206-860d-d4365074100f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:17.686838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.687391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.687686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.687995 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.709463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.731957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:17.732698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:17.732987 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:17.733268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:17.734518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=e6037ad69919420ab0fb4e92ad544513) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:17.734836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.736915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.747701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 49/94] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/role_assignments?user.id=e6037ad69919420ab0fb4e92ad544513&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:17.766265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:17.767796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:17.802456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:17.879931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:17.885539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:18.000064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39878340-1993-49c5-8ee5-ab5231404823 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:18.034707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:18.035676 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:18.035960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:18.036284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] PATH_INFO: `/v3/projects/0f42eccecc0e47668507d16548f3a4fc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:18.037614 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] RBAC: Authorizing `identity:get_project(project_id=0f42eccecc0e47668507d16548f3a4fc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:18.039116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da14db-5889-4209-a1c8-28aaf12b8806 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:18.041003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:17 2022] GET /identity/v3/projects/0f42eccecc0e47668507d16548f3a4fc => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:18.046701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:18.159811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc73f-fb31-4912-8241-143a53bac894 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:18.182412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:18.200935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:18.201617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:18.201903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:18.202215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:18.203061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=0f42eccecc0e47668507d16548f3a4fc, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:18.203383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:18.204872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4928-8dd8-4ee9-9de0-bce2f9840f83 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:18.211132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:18 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=0f42eccecc0e47668507d16548f3a4fc&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:19.613798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9200-fa9b-459f-b0f8-58e72306c5a6 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:19.614331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9200-fa9b-459f-b0f8-58e72306c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:19.614406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9200-fa9b-459f-b0f8-58e72306c5a6 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:19.615955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:19.621197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:19.621597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:19.621763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:19.642992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:19.644213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:19.717575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:19.751419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9200-fa9b-459f-b0f8-58e72306c5a6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:19.817572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:19.873617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9200-fa9b-459f-b0f8-58e72306c5a6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:19.907874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:19.908691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:19.908977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:19.909256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:19.919784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-16aaac4a-d366-4364-8460-8d7b0713f3fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:19.927646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:19.928552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:19.929296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 52/100] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:19.936308 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.023758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fb8b-71d5-446b-bcc7-9db767b24ac3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.024379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fb8b-71d5-446b-bcc7-9db767b24ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.024951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fb8b-71d5-446b-bcc7-9db767b24ac3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.026577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 53/101] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:20.041947 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.042570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.043042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.063881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:20.065350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:20.078349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a532af7-ed66-4184-8575-6e491e231c5f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:20.095635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:20.113708 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:20.114724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.115262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.115855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.116834 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:20.117384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:20.119002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:20.127627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:20.133184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.242144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e226-eb55-4f4f-80d9-0c2795797d0e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:20.288766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 54/103] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:20.290610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:20.291576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.291868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.292150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.294320 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:20.295800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:20.301643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:20 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:20.302922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.339582 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.416228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:20.424381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:20.528130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4497-38e4-434b-8e99-34f69eed0e41 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:20.584300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88437-45bb-4ce4-9e34-21874ef84077 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:20.599272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:20.600468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.600967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.601437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.620396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-245f6cc4-adc4-4772-b5ce-cb0c6377e267 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:20.629083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:20.630387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:20.631191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:20.635779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:20.637071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d8db-8591-45a1-b33d-bc0f6ea35107 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.637467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d8db-8591-45a1-b33d-bc0f6ea35107 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.637848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d8db-8591-45a1-b33d-bc0f6ea35107 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.638735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:20.639182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 52/106] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:20.639609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.639887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.640162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.643792 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d8db-8591-45a1-b33d-bc0f6ea35107 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.645144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:20.646935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6f963-c9e3-40dd-bd16-034282ba0736 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:20.648921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 55/107] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:20 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:20.654300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.654504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.654785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.684914 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:20.686060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:20.812859 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:20.815489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:20.834437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:20.840245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d8db-8591-45a1-b33d-bc0f6ea35107 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:20.907349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:20.916778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:20.917467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:20.917749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:20.918024 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:20.918813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:20.919124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:20.920515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:20.939000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:20.939777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.011516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31920c-5579-4908-9d7c-8012a1b77608 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.054058 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.055217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.055873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.056151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/acbf13c7456e4e498e3a2495f8b4838b/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.058657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, user_id=acbf13c7456e4e498e3a2495f8b4838b, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.060925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.072002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83df9-818a-478e-b643-c444e2deb87c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.079353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:20 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/acbf13c7456e4e498e3a2495f8b4838b/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:21.080837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.109877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.110858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.111188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.111465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.125176 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-78968fc0-646c-4856-946e-91cee5e8291e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:21.133998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:21.134956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:21.135744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:21.137256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2886e-35dd-49d9-ac78-d1c6cb9023ad None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.137256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2886e-35dd-49d9-ac78-d1c6cb9023ad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.137256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2886e-35dd-49d9-ac78-d1c6cb9023ad None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.143638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 55/112] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:21.144963 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad012-81b0-477c-a361-db121a6fe0a1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.145256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad012-81b0-477c-a361-db121a6fe0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.145534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad012-81b0-477c-a361-db121a6fe0a1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.147254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 56/113] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:21.147810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad012-81b0-477c-a361-db121a6fe0a1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.176223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.219168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb445823-e67f-407e-b1b6-d5d551fe1bd8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.223213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.272663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.273667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.274084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.274375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.275160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad012-81b0-477c-a361-db121a6fe0a1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.275708 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.278280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7c90b-70d7-4f95-ac24-83e128f99519 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.279982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:21.284627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.284781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.284989 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.307081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:21.308582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:21.318462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.319160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.319489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.319773 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.320552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:21.320870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.322325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019500-3eb7-4531-a3b9-c05e85bbdd57 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.332026 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 57/115] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:21.333315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.333605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.333884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.350713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:21.351916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:21.385333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:21.386658 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.430492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:21.431563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.452631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.500993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.508493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925da42c-5c41-4f44-8f1a-c85735e9daab None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.535866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f2c6-c2f2-4de8-b902-75e926fbbbf1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.550735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.551989 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.552282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.552925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.554360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.556140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d68f33-e6b7-4bbf-b7ec-d4a07e2b1a12 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.558520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:21.559766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2927f-fd07-4b2b-9849-331f8dae7c46 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.560052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2927f-fd07-4b2b-9849-331f8dae7c46 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.560327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2927f-fd07-4b2b-9849-331f8dae7c46 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.562886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 61/119] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:21.563609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2927f-fd07-4b2b-9849-331f8dae7c46 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.576631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.577524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.577809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.578162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] PATH_INFO: `/v3/users/a29ec3f2676c4ae286336c50a5791986` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.592185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ec3f2676c4ae286336c50a5791986)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.593988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.600100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 59/120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/users/a29ec3f2676c4ae286336c50a5791986 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:21.600100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.668867 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.678749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2927f-fd07-4b2b-9849-331f8dae7c46 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.701910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83901-bc1d-43d8-8fc6-2a2afaf17995 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.714211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.714910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.715260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.715545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.726467 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:21.734118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:21.734954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:21.735713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:21.736329 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.741558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.742395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.742675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.742942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.755594 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5ff2a530-6091-4a19-b536-b67c85ff88c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:21.763661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:21.764769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:21.765610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:21.766423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:21.766492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:21.766571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.767517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.767871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.784535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:21.785735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:21.853815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4eebc-ce8a-43d5-8500-8020f9743f3c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:21.858981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:21.867250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.889248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:21.890463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:21.890751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:21.891029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/acbf13c7456e4e498e3a2495f8b4838b/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:21.893788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, user_id=acbf13c7456e4e498e3a2495f8b4838b, role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:21.895591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:21.909642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:21 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/acbf13c7456e4e498e3a2495f8b4838b/roles/d9bf441543c64c42a197b79c49c8b17e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:21.910489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:21.947116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.004504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661cbee-da62-4292-8fe6-d473093893d1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.015565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.050984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291ff2-9d4c-460e-82bc-7b7fd7e0295e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.056144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.056955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.057303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.057673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.099581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.101426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.101426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.101426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.101661 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:22.101888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.103336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.114978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.115451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.143331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.145104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.224371 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.237739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae4e2-1634-4d48-ba20-3b616c239ed6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.269077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 62/126] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:22.274754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.280116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.280894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.281243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.281596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.282488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:22.282870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.284345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.297066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.298142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.311497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.388376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6676d-4524-4a04-bc32-95c576f8c12b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.416114 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebc08-fec0-4339-9364-a0e6f44f6981 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.425045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.425967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.426436 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.426790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.428212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.429825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.431971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.432705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.452870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.453772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.454075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.454363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.455791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.457154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.459422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.460207 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.465289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.544536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998208-9ebe-466c-8d33-cb71db100ade None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.559834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.583485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.584743 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.585265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.585717 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.587105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.588305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cffd8-88ff-4acb-a854-23915d2e3d09 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.589031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.596230 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.597240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.632488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.633693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.634204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.634742 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.636311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.638018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.640082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 67/131] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.641073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.715033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.720446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceaba0-6210-4db3-8d0c-88ad33ecf012 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.754250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e59b42-c8bd-4d38-827a-7b8c4cd67674 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:22.761369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.762171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.762525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.762868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.764054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.765948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.798119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:22.799367 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:22.799801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:22.800221 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:22.801259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 65/132] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:01:22 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:22.802354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.806319 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:22.808527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:22.817768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 68/133] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:22.819519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:22.872252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:22.963697 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a554e7-c169-4bd2-b884-fadfbcda66b9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.008469 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.009478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.009773 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.010071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.011215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=a29ec3f2676c4ae286336c50a5791986) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:23.011539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:23.013458 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:23.020629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 66/134] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/role_assignments?user.id=a29ec3f2676c4ae286336c50a5791986&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:23.021614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:23.046063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:23.106550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019b2f-3310-453f-b88e-ffdde52bc441 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.163441 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e8f4-5016-42a7-b4f0-d6979d61bc17 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.191031 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.192327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.193900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.194452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] PATH_INFO: `/v3/projects/0f42eccecc0e47668507d16548f3a4fc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.196064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] RBAC: Authorizing `identity:get_project(project_id=0f42eccecc0e47668507d16548f3a4fc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:23.197774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004faac9-e5c8-4b53-851c-4f393966067a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:23.204155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 69/135] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:22 2022] GET /identity/v3/projects/0f42eccecc0e47668507d16548f3a4fc => generated 312 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:23.206806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef81df-4839-468f-b0f0-f5dbd87dcdae None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.207331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef81df-4839-468f-b0f0-f5dbd87dcdae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.208421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef81df-4839-468f-b0f0-f5dbd87dcdae None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.210401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 70/136] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:23.211365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef81df-4839-468f-b0f0-f5dbd87dcdae None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:23.212347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.213438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.213715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.213989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/e6037ad69919420ab0fb4e92ad544513/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.218335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, user_id=e6037ad69919420ab0fb4e92ad544513, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:23.220158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061639b-1d0c-4775-b584-e7dfce190367 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:23.251428 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 67/137] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:23 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/e6037ad69919420ab0fb4e92ad544513/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:23.253146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.254514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.255028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.307265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:23.308824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:23.367243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:23.393427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef81df-4839-468f-b0f0-f5dbd87dcdae None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.434588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.435505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.435792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.436069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] PATH_INFO: `/v3/projects/0f42eccecc0e47668507d16548f3a4fc/users/acbf13c7456e4e498e3a2495f8b4838b/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.438545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f42eccecc0e47668507d16548f3a4fc, user_id=acbf13c7456e4e498e3a2495f8b4838b, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:23.440869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:23.484884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:23.487640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:23 2022] PUT /identity/v3/projects/0f42eccecc0e47668507d16548f3a4fc/users/acbf13c7456e4e498e3a2495f8b4838b/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:23.519287 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:23.704097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ab2d0-0cf1-4e27-8e56-b1754fd64625 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.739422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.740322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.740614 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.740895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.752938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:23.761269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:23.762671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:23.763451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 72/140] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:23.766405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:23.772357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:23.782062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:23.909848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1909-07f4-4821-81a8-08de26f659b3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:23.944820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:23.945508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:23.945793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:23.946146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:23.946921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:23.947228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:23.948623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:23.957422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 69/141] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:23.962886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:24.086883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3195e-1800-4dce-8ae3-195c687402c9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:24.120880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:24.121779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.122087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.122371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.123707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:24.125245 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:24.127231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 73/142] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:23 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:24.132583 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:24.207000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:24.243057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a67b-88d0-4831-a9be-f0bb4833386f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:24.277356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:24.278022 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.278338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.278618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.345923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:24.347511 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:24.410667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:24.446970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 70/143] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:24.452736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:24.541349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:24.584026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb785d93-9079-4964-aa4d-e3924a3fa548 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:24.632104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:24.633348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.633915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.634396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.638769 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:24.640487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a6bb4-c90f-4388-865a-ba11497973ae None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:24.642463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:24 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:24.648366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:24.793900 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0ae5-6343-4de1-b4fc-228e7b38f847 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:24.839973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:24.840658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.840946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.841220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.842099 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:24.842540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:24.844031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68e0cd-691b-4454-921e-00813dd1279a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:24.853624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 71/145] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:24 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:24.854053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c66b-4dd4-4332-b8b0-0752c602786f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.854866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c66b-4dd4-4332-b8b0-0752c602786f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.855345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c66b-4dd4-4332-b8b0-0752c602786f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.856960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 75/146] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:24.862985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:24.863293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:24.863541 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:24.888426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:24.889615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:24.917887 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:24.963482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 72/147] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:24.986610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6c66b-4dd4-4332-b8b0-0752c602786f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:25.107975 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6c66b-4dd4-4332-b8b0-0752c602786f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:25.151995 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:25.152822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.153100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.153372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.156078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:25.165885 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:25.174290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:25.175122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:25.175864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 76/148] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:25.182680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:25.287168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecdc1b-8804-441b-bcef-676418075c70 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:25.321961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:25.322687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.322967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.323241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.324060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:25.324380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:25.325754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:25.334219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 73/149] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:25.339585 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:25.457716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f0fc-0df4-429b-9162-88600d9fd45d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:25.498138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:25.499034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.499310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.499584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.500778 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:25.502266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be413c-3a5d-477b-b299-27c3f122d847 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:25.504138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 77/150] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:25 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:25.509750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:25.540598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:25.620945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfaebb-debc-47e6-948d-c00993b89af1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:25.660944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:25.661662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.661957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.662325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.753586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:25.755119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:25.772328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd412-6a80-413a-82c7-ab5f74f7cb84 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.772659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd412-6a80-413a-82c7-ab5f74f7cb84 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.772943 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdd412-6a80-413a-82c7-ab5f74f7cb84 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.774348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 78/151] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:25.779170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:25.779459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:25.779738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:25.791736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:25.803068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:25.804531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:25.901122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 74/152] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:25.906822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:25.915498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:25.924461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 79/153] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:25.961539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.015037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b2ee-9d64-42c7-9552-cf1589f25edb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.039084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:26.052156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.053105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.053391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.053672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.054930 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.056475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bbb82-0c27-46af-a8d7-c06d3bac6cc6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.058634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 75/154] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:25 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:26.064543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33f3c-731b-4ff6-a3d0-69fb2f7d5167 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.064838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33f3c-731b-4ff6-a3d0-69fb2f7d5167 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.065120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33f3c-731b-4ff6-a3d0-69fb2f7d5167 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.066650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 76/155] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:26.071358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33f3c-731b-4ff6-a3d0-69fb2f7d5167 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.112095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dac97-564a-4748-8db6-3ce1b2aed330 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.158447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.160022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.160523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.161328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.163179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.165793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441a0b-3652-41e7-ac7f-d4b67a9b58a1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.168627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 80/156] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:26.170622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.171820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.172951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.187211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33f3c-731b-4ff6-a3d0-69fb2f7d5167 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.201429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:26.203586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:26.227759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.228554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.228905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.229175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.230134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:26.230517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.232560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.246061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:26.246061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.320828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:26.333670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:26.342160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 81/158] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:26.362071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.412869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e373f7-0d75-4c1f-9fdb-9ee06696b716 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.460946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.461979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.462526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.462997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.463921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.465634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.487210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475a34-86f9-4eb4-9fe9-4376f504460f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.489345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 78/159] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:26 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:26.550629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.551991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.552480 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.553075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.567039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-542b1c5e-d862-43ee-945a-f96adf1192c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:26.577571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:26.578497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:26.579260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 82/160] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:26.591222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.662856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ba9e-a717-42a2-a849-fbc6d0b5d143 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.663178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ba9e-a717-42a2-a849-fbc6d0b5d143 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.663405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ba9e-a717-42a2-a849-fbc6d0b5d143 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.664791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 83/161] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:26.670332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6f95-db71-4421-9a53-e1880cce8296 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.670670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6f95-db71-4421-9a53-e1880cce8296 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.670890 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6f95-db71-4421-9a53-e1880cce8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.691147 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-af0a6f95-db71-4421-9a53-e1880cce8296 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:26.692634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-af0a6f95-db71-4421-9a53-e1880cce8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:26.716327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2833-9eab-4e81-a5d3-1b0c80dbd84d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.730673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:26.755264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:26.766096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.766763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.767046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.767326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.768090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:26.768400 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.769797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a87b3-22d4-4155-b613-62966d5aa6c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.782167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 79/162] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:26.782167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94748fe-85f4-496f-93aa-50d5b44042d4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.782167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94748fe-85f4-496f-93aa-50d5b44042d4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.782167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94748fe-85f4-496f-93aa-50d5b44042d4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.782607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 80/163] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:26.784526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94748fe-85f4-496f-93aa-50d5b44042d4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.785195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 84/164] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:26.789112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.789478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.789822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.809831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:26.811163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:26.892623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 85/165] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:26.893300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:26.915874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94748fe-85f4-496f-93aa-50d5b44042d4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:26.970866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:26.971765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:26.973771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:26.973771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] PATH_INFO: `/v3/users/a29ec3f2676c4ae286336c50a5791986` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:26.973771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] RBAC: Authorizing `identity:get_user(user_id=a29ec3f2676c4ae286336c50a5791986)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:26.975161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:26.976817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 81/166] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/users/a29ec3f2676c4ae286336c50a5791986 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:26.977576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.017631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fd4ac-8032-48ae-9c77-b9f48b0a1072 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.031233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.037175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.059726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.060536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.060813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.061191 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.072521 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:27.080745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:27.081602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 86/167] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:27.083154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.104653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c180f8-5bb9-4c6c-90cf-358f420239cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.153498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.154349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.154631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.154901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.173311 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:27.181153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:27.182124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:27.183259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 82/168] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:27.183925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.222910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890812a5-74b0-4cc4-881f-fe7c66ec2a00 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.267557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.268955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.269240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.269777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.271044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.272865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.274931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 87/169] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:27.275766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.322749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.388819 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ccff-b38f-4034-b11f-3e3e7cc78087 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.407367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.413195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6803d-de81-45c0-a0b1-b888cc5a3b42 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.428771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.429795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.430255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.431238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.432171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:27.432638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.434565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.445129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 88/170] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:27.450815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.506860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.507652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.508006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.508357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.509197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:27.509599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.516871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.532652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 83/171] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:27.533783 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.568674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f583-db0c-4dbf-a02d-2edaa4d4f57c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.570887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.609617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.611017 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.611471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.611910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/a29ec3f2676c4ae286336c50a5791986/roles/296c91cf1c8a4e8e856b1970cd0dd3bb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.614340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, user_id=a29ec3f2676c4ae286336c50a5791986, role_id=296c91cf1c8a4e8e856b1970cd0dd3bb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.616992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.645439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 89/172] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:27 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/users/a29ec3f2676c4ae286336c50a5791986/roles/296c91cf1c8a4e8e856b1970cd0dd3bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:27.646616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.739901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823ec0-3378-4c02-ad25-4e329988371a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.778303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.779641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.780208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.780664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] PATH_INFO: `/v3/users/e6037ad69919420ab0fb4e92ad544513` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.782073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=e6037ad69919420ab0fb4e92ad544513)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.783842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.785789 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 84/173] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/users/e6037ad69919420ab0fb4e92ad544513 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:27.792679 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.853362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:27.867519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8fa58-7f8d-4694-8d5b-a998aabe6894 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.925707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.926983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.927336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.927719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] PATH_INFO: `/v3/users/acbf13c7456e4e498e3a2495f8b4838b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.935671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] RBAC: Authorizing `identity:get_user(user_id=acbf13c7456e4e498e3a2495f8b4838b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:27.937278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:27.939334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/users/acbf13c7456e4e498e3a2495f8b4838b => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:27.944621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:27.947996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3f3b-de7d-4eb4-b3df-f20f8caef7d0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:27.984388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:27.985344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:27.985827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:27.986308 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:27.999566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.066845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.068700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.096727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35582a9-f29f-4e47-ba3c-dba0f54f10bf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:28.101090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.153031 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:28.153948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:28.154366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:28.154698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:28.175043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 85/175] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:28.181084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:28.261076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.262727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.285549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da2f-de10-461c-9146-0b96ab7d0cdb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:28.308719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.318444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.324480 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:28.326076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:28.326332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:28.326910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:28.328468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.330182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.338169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 86/176] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:28 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:28.338169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:28.420785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 91/177] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:28.425856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:28.442140 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e63e-19ea-47ee-8455-5328e58e4b40 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:28.479378 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:28.480191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:28.480571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:28.480941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:28.485342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=e6037ad69919420ab0fb4e92ad544513) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:28.485342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.485342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.490763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 87/178] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:28 2022] GET /identity/v3/role_assignments?user.id=e6037ad69919420ab0fb4e92ad544513&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:28.587797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73948-b1cc-43b9-b68a-72c511d8d863 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:28.666071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.672412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:28.673296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:28.673576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:28.673852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] PATH_INFO: `/v3/projects/0f42eccecc0e47668507d16548f3a4fc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:28.675101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] RBAC: Authorizing `identity:get_project(project_id=0f42eccecc0e47668507d16548f3a4fc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.676582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001fb18-99f5-4bf7-a7a0-fd5ffbb5437d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.678491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 92/179] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:28 2022] GET /identity/v3/projects/0f42eccecc0e47668507d16548f3a4fc => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:28.685098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:28.773312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:28.824859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a068-abf7-46d5-a11b-da6eff82163c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:28.873202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:28.873873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:28.874174 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:28.874449 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:28.875288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=0f42eccecc0e47668507d16548f3a4fc, user.id=acbf13c7456e4e498e3a2495f8b4838b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:28.875600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:28.877043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7205f-85c6-4289-8564-9a4e5bc9fbcb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:28.886531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 88/180] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:28 2022] GET /identity/v3/role_assignments?user.id=acbf13c7456e4e498e3a2495f8b4838b&scope.project.id=0f42eccecc0e47668507d16548f3a4fc&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:29.259299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f9d4-0910-4567-b825-e791c4b3daf4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.259811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f9d4-0910-4567-b825-e791c4b3daf4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.259885 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f9d4-0910-4567-b825-e791c4b3daf4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.261448 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 93/181] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:29.271513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e77d-2c24-474b-a356-3e04ac92c51f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.271980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e77d-2c24-474b-a356-3e04ac92c51f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.272053 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e77d-2c24-474b-a356-3e04ac92c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.291545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4db9e77d-2c24-474b-a356-3e04ac92c51f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:29.292749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4db9e77d-2c24-474b-a356-3e04ac92c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:29.361733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 89/182] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:29.384643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f9d4-0910-4567-b825-e791c4b3daf4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.481475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc07-51a6-437a-a5c8-852ad818e315 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.481796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc07-51a6-437a-a5c8-852ad818e315 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.482848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bc07-51a6-437a-a5c8-852ad818e315 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.484661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 90/183] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:29.490957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.491757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.491757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.498235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f9d4-0910-4567-b825-e791c4b3daf4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:29.514157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:29.515438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:29.535737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:29.536798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.537406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.537826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.549369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:29.558683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:29.559611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:29.560552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:29.562723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 94/184] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:29.569346 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.581333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:29.602167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 91/185] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:29.627610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.635838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:29.684584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01cb-3e3f-4cc5-9631-347f0cdadc6a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:29.719922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:29.720841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.721257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.721659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.722584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:29.723107 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:29.726143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:29.735306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 95/186] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:29.739754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045f76-2cc8-462d-82f8-37845b067ca9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:29.741066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.773679 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:29.774641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.775020 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.775418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.776706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:29.778451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:29.780482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:29.785814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.843300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:29.849183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcabca-0048-4656-946a-a02ccd9d557a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:29.882540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:29.886728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:29.887855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.888325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.888926 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.891430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7781c-c6b5-4060-8560-379444fcb189 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:29.902705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:29.904172 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b50e-c0f3-4d33-af33-24f66324392c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:29.905881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 96/188] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:29 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:29.911462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62cc-65f7-4505-b510-2b2c2d65d3fe None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.911744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62cc-65f7-4505-b510-2b2c2d65d3fe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.912508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62cc-65f7-4505-b510-2b2c2d65d3fe None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.913945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 97/189] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:29.918380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f62cc-65f7-4505-b510-2b2c2d65d3fe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:29.925739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:29.926632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.927084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.927522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.928474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:29.930093 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf880a-adea-4003-a901-2ea248d29549 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:29.965535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 93/190] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:29 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:01:29.965535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:29.965535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:29.965535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:29.983339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:29.984631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:30.035180 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f62cc-65f7-4505-b510-2b2c2d65d3fe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.059459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 94/191] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:30.077535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.078491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.078776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.079091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.084264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.137730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.142768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.169931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:30.171455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:30.202233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0cb1-bc3b-4ca0-a913-c56b4553ef36 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.254945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19b760-5895-4090-980d-98906aca089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.257200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b760-5895-4090-980d-98906aca089d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.257200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b760-5895-4090-980d-98906aca089d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.257200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19b760-5895-4090-980d-98906aca089d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.269504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19b760-5895-4090-980d-98906aca089d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1e19b760-5895-4090-980d-98906aca089d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:30.280034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:30.281345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:30.282145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:30.287674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19b760-5895-4090-980d-98906aca089d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.320638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 98/193] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:30.326478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.414647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.417748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19b760-5895-4090-980d-98906aca089d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.422935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.445297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f77aa5-f457-4b58-a545-ffcb3b974260 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.455807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.456593 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.456881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.457161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.457933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:30.458276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:30.460030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e533ea-69b2-412d-8489-0daf3fd96a6f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:30.470919 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:30.472342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb566-758a-468f-a902-7e1b8fac9679 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.472635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb566-758a-468f-a902-7e1b8fac9679 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.472915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb566-758a-468f-a902-7e1b8fac9679 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.474658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 97/195] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:30.479242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb566-758a-468f-a902-7e1b8fac9679 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.482358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.483244 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.483531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.483809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.485022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:30.486534 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd1d6-a612-4dbd-9e8a-e841241c1fe4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:30.488252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:30.489466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.489755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.494065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.512168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:30.513371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:30.583887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 100/197] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:30.584554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.600052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb566-758a-468f-a902-7e1b8fac9679 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.637050 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.637950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.638297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.638575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.639791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:30.641411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:30.643301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:30.644240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.666625 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.687676 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.690656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194a05-003b-4cf2-afc9-10deb59715bb None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.726396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.727087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.727373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.727653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.728505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=7d431bc1fb014c23b2a6e6d17895a797) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:30.728830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:30.730335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:30.737937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 101/199] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/role_assignments?user.id=7d431bc1fb014c23b2a6e6d17895a797&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:30.738928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.790063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2618e6-f29e-4c73-aef1-60e40c1c933b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.851155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:30.851911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:30.852195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:30.852472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:30.864615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:30.873622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:30.874603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:30.875380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 99/200] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:30.882872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:30.958911 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c031bfb-99b9-4177-813b-f5f13ff01eda None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:30.986053 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:30.998781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2419c-d4a3-41d8-a08e-aa49fd077dc2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:31.027973 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.028641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.028925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.029236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.047388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:31.062291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.062979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.063265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.063545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.065128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:31.065653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.067091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.087008 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:31.093139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:31.163912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.167578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.300029 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a060db-9f3f-4adb-83e4-2298e8e3acea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:31.326775 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:31.335072 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:31.376254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.377149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.377427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.377703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] PATH_INFO: `/v3/users/a29ec3f2676c4ae286336c50a5791986` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.379630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ec3f2676c4ae286336c50a5791986)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.381159 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.383012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 101/203] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:31 2022] GET /identity/v3/users/a29ec3f2676c4ae286336c50a5791986 => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:31.390075 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:31.411389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:31.431507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:31.524364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bbde-5065-4bfd-812e-7a02f021eb1c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:31.552032 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17896-8203-4311-9822-41af19ca0f04 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:31.591375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.592298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.592579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.592850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.623278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.624168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.624457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.624735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.630824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.632325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.634430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:31 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:31.642691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:31.677176 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.679039 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.707296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:31.797619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 102/205] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:31.803658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:31.840070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8cf90-b91e-4e9b-b7a7-1ac95b007961 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:31.850415 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:31.876008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:31.876674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:31.876960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:31.877240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:31.879418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=7d431bc1fb014c23b2a6e6d17895a797) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:31.879418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:31.880276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:31.886591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 104/206] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:31 2022] GET /identity/v3/role_assignments?user.id=7d431bc1fb014c23b2a6e6d17895a797&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:31.994756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644534a-5f43-48e7-a56e-181f802713ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:32.029180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:32.053635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:32.054797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.055224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.055642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.057038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:32.058868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde233f-d4e1-4cac-ae1e-b7f40104d436 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:32.060893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:31 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:32.066867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:32.176722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2c54d-03ee-438b-b9e7-a712a22eabb6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:32.217510 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:32.218211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.218499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.218778 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.219632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, scope.project.id=4cee93e7c9664996813c5c7b5e681e88, user.id=a29ec3f2676c4ae286336c50a5791986) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:32.219948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:32.221407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40a07-26d3-4043-b702-5e83c664895b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:32.234544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 105/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:32 2022] GET /identity/v3/role_assignments?user.id=a29ec3f2676c4ae286336c50a5791986&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:32.640171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04c2-246b-4dd0-abad-136128cd9098 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.641185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04c2-246b-4dd0-abad-136128cd9098 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.641681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04c2-246b-4dd0-abad-136128cd9098 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.643280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:32.650127 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.650954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.651433 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.670047 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211db32-edfe-4c3d-9cad-3fe8ebf049c8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.670367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211db32-edfe-4c3d-9cad-3fe8ebf049c8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.670576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:32.670674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211db32-edfe-4c3d-9cad-3fe8ebf049c8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.671792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:32.672244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 105/210] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:32.677778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.678096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.678379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.705305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:32.706553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:32.712160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:32.775655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:32.787080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:32.802354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:32.816509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:32.917962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe84432-eec0-461a-bff4-5ee69004a62b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:32.925335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82ef4-e118-4c13-a356-dd4225c4f570 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:32.948690 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:32.964206 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:32.965904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.966366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.966774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.968400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:32.970117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:32.970293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:32.971227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:32.971641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:32.972012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:32.976876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 107/213] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:32.977838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:32.990793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:33.001713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:33.002779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:33.003570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:33.006110 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 107/214] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:33.010075 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.025842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.100395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfb49b-e65d-4cce-b433-a30bc86d2017 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.131956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7776c-7cff-4e15-90a6-b91e95fc9aba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.137405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.138342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.138850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.139262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.140124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.141710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c2c08-9af6-4ff5-920a-7fb6cccac579 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.163481 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 108/215] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:32 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:01:33.168280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.168918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.169200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.169483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.170256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:33.170561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.172000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.175696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67afd-af30-44ab-b8e7-0537aafc4843 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.175984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67afd-af30-44ab-b8e7-0537aafc4843 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.176268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67afd-af30-44ab-b8e7-0537aafc4843 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.178068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 109/216] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:33.185999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 108/217] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:33.187592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.187878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.188164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.191430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.207020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:33.208389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:33.242696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.284194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 110/218] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:33.306844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.309474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055bcc9-2567-4c22-8c6a-1b79ef45cc0c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.330984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.345317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.346450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.346866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.347289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] PATH_INFO: `/v3/users/cbe647d923d84338bd19bbd2aeae7a91` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.361710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe647d923d84338bd19bbd2aeae7a91)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.363408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.365710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 109/219] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/users/cbe647d923d84338bd19bbd2aeae7a91 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:33.371089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.424102 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3f52a-4d66-4235-934f-b1b71042d8f5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.470755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.471817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.472101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.472374 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.475627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.481283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d8ee-1f3e-4ff5-a966-0325e69137d2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.491497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:33.499617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:33.500788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:33.501758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:33.503892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:33.510411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.533240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.534175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.534588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.535009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.613735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.614493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.616664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.640143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb65a-a07e-4dc3-b002-4a2a688a40b0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.698922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.699677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.699929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.700214 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.700991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:33.701305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.702996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.714762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 112/221] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:33.723134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.755487 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:33.760489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 110/222] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:01:33.766941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.891851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febf7b-65ba-4b02-accb-12ebeceee7d2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.928582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:33.929439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:33.929723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:33.930000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:33.935486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:33.937152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:33.939146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:33.944689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:33.951598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90ff9-3224-4e91-93e5-6dbd1fcef281 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:33.968722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.034292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.035601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.036086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.036590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.038065 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.046059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.048331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:34.054376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:34.076085 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb7c29-4afa-4e6a-9291-2d5e1eb06fae None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.110624 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.111796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.112077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.113292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.114799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c190712-4be2-40a0-8880-001834f9908c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.121063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 114/225] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:33 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:34.121063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641575-4aaa-408c-bbbf-2f1f8e60c087 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.121063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641575-4aaa-408c-bbbf-2f1f8e60c087 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.121063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641575-4aaa-408c-bbbf-2f1f8e60c087 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.121063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 115/226] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:34.125139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641575-4aaa-408c-bbbf-2f1f8e60c087 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:34.142844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.181975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6da5e-ead8-41ff-8ac3-fbd670d64b13 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.219312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.233221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.234628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.235350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.235809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.237484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=cbe647d923d84338bd19bbd2aeae7a91) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:34.238141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.240237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be89f-0372-4555-a918-2de115a04bea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.244674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641575-4aaa-408c-bbbf-2f1f8e60c087 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.259066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:34 2022] GET /identity/v3/role_assignments?user.id=cbe647d923d84338bd19bbd2aeae7a91&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:34.260950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.261442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.261886 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.282227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:34.284057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:34.334113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.335190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.335530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.335808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/7d431bc1fb014c23b2a6e6d17895a797/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.339493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, user_id=7d431bc1fb014c23b2a6e6d17895a797, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.341034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.366694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 113/228] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:34.383299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:34 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/7d431bc1fb014c23b2a6e6d17895a797/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:34.409361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:34.489086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.534941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0302fe5-eeb6-43c7-b90c-a77eddb479d0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.577765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.578985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.579468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.579941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.595841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:34.604724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:34.605655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:34.606485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:34.608989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:34.618111 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:34.735400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32853c-31ee-4021-b51c-20fe53f05254 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.773675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.774711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.775194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.775665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.776636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:34.777158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.778771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.784397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.788830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:34.794967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:34.932582 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c390-5625-4790-9334-b537343803e6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:34.953596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:34.967667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:34.968565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:34.968881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:34.969136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:34.970398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:34.971875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:34.978379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:34 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:34.983140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:35.144334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b583-851e-4212-bae4-0194a51e94be None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:35.190737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:35.192064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.192560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.193095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.194564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:35.196233 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569086a8-70a2-41af-b662-6c6bf2d54926 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:35.198198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 118/233] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:34 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:35.204143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:35.329077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd96fb-34cf-41cd-b04c-7e5a7bd16cf8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:35.363010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:35.363939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.370405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.370702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/7d431bc1fb014c23b2a6e6d17895a797/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.373036 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, user_id=7d431bc1fb014c23b2a6e6d17895a797, role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:35.374550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bb87-ef26-4b55-8764-e0c9df0ad093 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:35.394797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:35 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/7d431bc1fb014c23b2a6e6d17895a797/roles/d9bf441543c64c42a197b79c49c8b17e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:35.801995 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79ad4-7594-47a6-a45d-ea52fb3b326d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.803140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79ad4-7594-47a6-a45d-ea52fb3b326d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.803646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79ad4-7594-47a6-a45d-ea52fb3b326d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.805463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 119/235] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:35.816578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.817444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.817920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.848173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae11-a2ba-44d1-9249-113caeadd67a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.848471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae11-a2ba-44d1-9249-113caeadd67a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.848736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae11-a2ba-44d1-9249-113caeadd67a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.850170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 120/236] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:35.854889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:35.855267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:35.855589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:35.859669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:35.860873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:35.887169 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:35.888387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:35.919743 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:35.947217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 117/237] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:35.999799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:36.008144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:36.009631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.047669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.125537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3727ed-eb1f-4f8a-8e99-613da7f47c4e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.164152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.165318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.165821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.166310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.168364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:36.170222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:36.172089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:36.178120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.234701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:36.272835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fa126-b7bc-4a3b-b577-129c0aacd3d4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.291147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ae84-9c26-4cd0-9868-cdc719b0f50c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.329097 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.330575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.331326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.332083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.334772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:36.337220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:36.361575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.362815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.363418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.364085 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.375876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 119/240] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:36 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:01:36.383077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-822fe431-894a-4e40-9809-2ad5e4f6da7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:36.391551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:36.392552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:36.393339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:36.395876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 122/241] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:36.403484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.553386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b28ab-06ac-4a91-83e5-7ec0fafe639d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.555486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:36.558697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a381-9cbe-4eeb-aa39-82ede8dbb3a9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.558998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a381-9cbe-4eeb-aa39-82ede8dbb3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.559278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a381-9cbe-4eeb-aa39-82ede8dbb3a9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.560794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 123/242] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:36.566801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.566801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.567138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.589863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:36.591390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:36.601202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.602766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.603259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.603736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.605126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:36.606045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:36.608238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:36.620434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 120/243] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:36.625678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.657204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:36.685320 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 124/244] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:36.709026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.762860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d21c-d6d4-448a-954f-51053f8fcfd0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.808280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.809616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.809616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.809809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] PATH_INFO: `/v3/users/90d236bc229b41b594eb2b474ac788b1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.825575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] RBAC: Authorizing `identity:get_user(user_id=90d236bc229b41b594eb2b474ac788b1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:36.827324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:36.829168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 121/245] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/users/90d236bc229b41b594eb2b474ac788b1 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:36.839211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.853800 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b75d0-4d2b-49a2-a77e-b5ae3444ced2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:36.874422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:36.910812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:36.911744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:36.912157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:36.912534 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:36.931395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:36.940620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:36.941719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:36.942710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:36.944580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 125/246] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:36.950528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:36.975810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d96575-147f-4ec4-890f-a6b8d1d3dac7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.013780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.020467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.021422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.021869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.022305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.105813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:37.107643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936d92-cabd-4e05-8d18-903f1e07759f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:37.132220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c558-8d97-4f65-90af-b92af58066cd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.149663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.228071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.228766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.229049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.229322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.230116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:37.230427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:37.231855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd0a5-1d9b-4c2c-ac38-9e88f081fe31 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:37.249491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 126/247] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:37.252184 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9e81-8bd9-4474-97f6-5c7d7aee85cc None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.255294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9e81-8bd9-4474-97f6-5c7d7aee85cc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.256081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9e81-8bd9-4474-97f6-5c7d7aee85cc None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.258904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 127/248] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:37.259971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9e81-8bd9-4474-97f6-5c7d7aee85cc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.280809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 122/249] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:37.282413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.284296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.284754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.313815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:37.316086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:37.418994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 123/250] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:37.420216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.474852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9e81-8bd9-4474-97f6-5c7d7aee85cc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.476995 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.499699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.531992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b133a3-86e1-4597-9877-ab8cec15334a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.560609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.561502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.561785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.562074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] PATH_INFO: `/v3/users/cbe647d923d84338bd19bbd2aeae7a91` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.563300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe647d923d84338bd19bbd2aeae7a91)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:37.564782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:37.566465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 128/251] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:37 2022] GET /identity/v3/users/cbe647d923d84338bd19bbd2aeae7a91 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:37.567238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.592172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.593062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.593348 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.593629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.594876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:37.596350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:37.598109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 124/252] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:37 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:37.598900 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.742653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa979a-74f5-49b1-88f6-85f05d8ca3b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.765318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.780322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a33f7-23cd-40f6-9136-f20cd9731d64 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:37.784227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.785123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.785407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.785684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.786983 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:37.789422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:37.795594 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 125/253] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:37 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:37.796705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.831423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:37.832222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:37.832508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:37.832782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:37.857516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:37.874068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:37.874982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:37.875763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 129/254] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:37.876398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:37.942164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:37.976334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab408-57f7-4b19-bbec-764ade26a950 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.007829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a80d-c9ed-4f06-b804-f126a0937afc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.019870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.020749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.021060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.021366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.022552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=90d236bc229b41b594eb2b474ac788b1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:38.023353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.025095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.032468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 126/255] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:37 2022] GET /identity/v3/role_assignments?user.id=90d236bc229b41b594eb2b474ac788b1&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:38.033290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:38.070143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.071672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.072124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.072573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/cbe647d923d84338bd19bbd2aeae7a91/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.079833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, user_id=cbe647d923d84338bd19bbd2aeae7a91, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.081335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5487bea-6ebe-462a-be39-db4a837b0078 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.095554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:38.121328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 130/256] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:37 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/cbe647d923d84338bd19bbd2aeae7a91/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:38.122805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea71be-4c87-41e6-9059-0521c073e1e5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.123095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea71be-4c87-41e6-9059-0521c073e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.123367 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea71be-4c87-41e6-9059-0521c073e1e5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.134504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 131/257] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:38.136041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.136326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.136604 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.153207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8851fea-0e5d-4a24-9428-3cd88117ec32 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.178166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:38.179470 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:38.226907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.227630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.227921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.228206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.229009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:38.229324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.230846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.251005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:38.260992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:38.331977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 132/259] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:38.358531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:38.408613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:38.469678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf05-540c-45eb-8576-5c0bf6fd6ac0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.484195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:38.525457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.527372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.527483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.527776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.538056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.538056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.538056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:38.542512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:38.543984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93878516-9e9c-4a99-9364-ea41591fcbad None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.610916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.611678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.611962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.612280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.639160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:38.659519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:38.660434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:38.661204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 133/261] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:38.671030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:38.716234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48bc8a-1705-474d-a317-275feb0967e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.808284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.808955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.809287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.809521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.837334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:38.876273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c5b2-fd8e-445b-81fb-01e30c969393 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:38.920102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:38.957301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.958796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:38.959013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.959496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:38.959781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:38.960059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:38.960826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:38.961134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:38.962595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:38.980428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 134/262] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:38.985835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.065975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 129/263] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:39.075369 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.202320 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:39.226345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f255ae7-27d1-4a66-8cff-f95e34ce90f0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:39.269625 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:39.270589 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.270877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.271206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.274794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:39.276172 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b93-cd11-4c2a-8f50-65175440d327 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:39.276560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:39.278527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 130/264] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:39.284001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.367280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:39.368167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.368447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.368719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] PATH_INFO: `/v3/users/7d431bc1fb014c23b2a6e6d17895a797` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.374760 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] RBAC: Authorizing `identity:get_user(user_id=7d431bc1fb014c23b2a6e6d17895a797)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:39.376232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16022891-f28c-4f8d-abe0-94264cd8286a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:39.377892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 135/265] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:38 2022] GET /identity/v3/users/7d431bc1fb014c23b2a6e6d17895a797 => generated 283 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:39.379185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3fd5-e365-4aa6-a408-4f603782939d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.379468 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3fd5-e365-4aa6-a408-4f603782939d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.379743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3fd5-e365-4aa6-a408-4f603782939d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.381002 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 136/266] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:39.386486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475e23-fc7e-4027-8773-30a780b09183 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.386772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475e23-fc7e-4027-8773-30a780b09183 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.387053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475e23-fc7e-4027-8773-30a780b09183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.396910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edd65-6163-41ce-8dab-c5c6acd1095e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:39.423014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-33475e23-fc7e-4027-8773-30a780b09183 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:39.424239 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-33475e23-fc7e-4027-8773-30a780b09183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:39.437626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:39.438386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.438670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.438949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.439831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=7d431bc1fb014c23b2a6e6d17895a797) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:39.440149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:39.441663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:39.451974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:39.459445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 131/267] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/role_assignments?user.id=7d431bc1fb014c23b2a6e6d17895a797&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:39.460665 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.494160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:39.562265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 137/268] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:39.602886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700d17-75a7-468a-b195-02e2bd2a2c2c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.603203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700d17-75a7-468a-b195-02e2bd2a2c2c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.603453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700d17-75a7-468a-b195-02e2bd2a2c2c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.605075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 138/269] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:39.607102 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4700d17-75a7-468a-b195-02e2bd2a2c2c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.653869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5865ee-217b-4ca6-a8bf-d33b3bccb2cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:39.693742 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:39.694450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.694741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.695023 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.769941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:39.771556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:39.785474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4700d17-75a7-468a-b195-02e2bd2a2c2c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:39.787754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:39.835429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:39.836250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.836547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.836809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.863239 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dd5e3117-9f54-48ba-9acb-9b48147494bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:39.871202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:39.872039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:39.872811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:39.873418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 139/270] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:39.883181 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce430ab0-8750-4693-8445-0342f770113a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:39.883181 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce430ab0-8750-4693-8445-0342f770113a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:39.883181 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce430ab0-8750-4693-8445-0342f770113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:39.883921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 132/271] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:39.883921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.907055 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ce430ab0-8750-4693-8445-0342f770113a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:39.908486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ce430ab0-8750-4693-8445-0342f770113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:39.910780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:39.986299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 140/272] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:39.987453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce430ab0-8750-4693-8445-0342f770113a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:39.992165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f52a5-a855-4acc-86df-a85b9d23bf9c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.008834 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.033561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.034242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.034554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.034834 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.035730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:40.036042 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.037651 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.047319 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 133/273] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.048418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.097586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce430ab0-8750-4693-8445-0342f770113a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.132899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.134136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.134636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.135098 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.136557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.138286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.140202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 141/274] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:39 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.145814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.155448 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.159608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f7cf-bd2d-4b1d-8b15-a85ceff0e34c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.199746 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.200560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.200845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.201117 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.204987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.206486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.208304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 134/275] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.210319 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.259960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.279101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f89af-d5e2-4328-b250-c5117af837a2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.316856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.317660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.317969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.318284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] PATH_INFO: `/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.330386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adec39-86bf-40c1-96b2-91a3a3fe7de9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.332199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] RBAC: Authorizing `identity:get_user(user_id=7d10cf56d2274a0e8c251fdb2ea441e9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.334386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.335899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 142/276] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.336759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.376898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.378464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.378980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.379910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.381478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=7d431bc1fb014c23b2a6e6d17895a797) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:40.382339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.384742 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.393615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 135/277] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/role_assignments?user.id=7d431bc1fb014c23b2a6e6d17895a797&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.395043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.427719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.524430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41644d5-96bf-4407-976d-5b85d445425b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.537127 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404b23-9ac2-457c-b9c6-4f09dc5d1d0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.538128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.591836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.593448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.594250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.594998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.597724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, user.id=7d10cf56d2274a0e8c251fdb2ea441e9, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:40.598608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.601917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cc6ac-6cbf-4dba-805f-c3a4c87d0bcc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.614633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 136/278] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/role_assignments?user.id=7d10cf56d2274a0e8c251fdb2ea441e9&scope.system=all&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:40.621024 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54ece-a8c8-4374-8a26-600dcfdfbf37 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.621638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54ece-a8c8-4374-8a26-600dcfdfbf37 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.621986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54ece-a8c8-4374-8a26-600dcfdfbf37 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.624856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 137/279] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:40.625058 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.625654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.625939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.626261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.627078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:40.628556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:40.633455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed4d4-2fcd-4191-9e56-e3cee2ea2781 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.633917 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed4d4-2fcd-4191-9e56-e3cee2ea2781 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.636627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ed4d4-2fcd-4191-9e56-e3cee2ea2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.658175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 143/280] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:01:40 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:40.670654 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-627ed4d4-2fcd-4191-9e56-e3cee2ea2781 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:40.671585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-627ed4d4-2fcd-4191-9e56-e3cee2ea2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:40.758636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 138/281] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:40.782445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.902482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1f3e1-cb6f-4630-89c6-3b4694a5216e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:40.923939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:40.941507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:40.942728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.943240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.943709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.955421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:40.963639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:40.964537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:40.965318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:40.967584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 144/282] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:40.971599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3914-6832-45ae-8c14-2e3076c62d25 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.972103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3914-6832-45ae-8c14-2e3076c62d25 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.972685 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3914-6832-45ae-8c14-2e3076c62d25 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:40.973429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:40.974598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 139/283] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:40.979659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:40.979948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:40.980227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.000788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:41.001994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:41.083593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbb6a3-8c31-42ad-9d2b-3b88706b734b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.084897 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 140/284] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:41.111257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.122159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.123149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.123634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.124092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.125032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:41.125559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.127222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.138084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 145/285] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:41.146064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.154471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:41.203111 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:41.248604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e5e44-90f0-4086-82d4-8cc1ceeda16e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.269902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377244b9-2734-4081-a055-535a1c417ce9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.306687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.307574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.308170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.308442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] PATH_INFO: `/v3/users/90d236bc229b41b594eb2b474ac788b1` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.309709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] RBAC: Authorizing `identity:get_user(user_id=90d236bc229b41b594eb2b474ac788b1)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.311249 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.313320 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 146/286] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/users/90d236bc229b41b594eb2b474ac788b1 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:41.313709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.318185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.318185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.318185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.322927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.345074 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:41.353162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:41.354247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:41.355241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:41.359265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 141/287] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:41.365185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.450974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abe4f3-64d2-4212-9324-6a24b7e18911 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.461913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:41.462118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:41.471856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b2b-c54a-4fe0-9fb9-c91792a2270e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.488341 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.489230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.489504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.489828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.491079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.492738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.494481 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 147/288] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:41.499984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.519578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.520623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.522770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.523251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.524496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:41.530505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.531980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.553722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 142/289] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:41.559271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.630700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0fc0-be99-4c34-bafe-5374a06001b3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.672547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.673878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.674379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.674875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/90d236bc229b41b594eb2b474ac788b1/roles/296c91cf1c8a4e8e856b1970cd0dd3bb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.677096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, user_id=90d236bc229b41b594eb2b474ac788b1, role_id=296c91cf1c8a4e8e856b1970cd0dd3bb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.678897 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.706868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 148/290] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:01:41 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/users/90d236bc229b41b594eb2b474ac788b1/roles/296c91cf1c8a4e8e856b1970cd0dd3bb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:01:41.760163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0640-ecc0-4308-b8df-42d9eb6a1369 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.798047 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.799381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.799869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.800334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] PATH_INFO: `/v3/users/cbe647d923d84338bd19bbd2aeae7a91` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:41.802014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe647d923d84338bd19bbd2aeae7a91)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:41.803831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:41.805863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 143/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/users/cbe647d923d84338bd19bbd2aeae7a91 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:41.811996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:41.870702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:41.937622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec69876-7115-4498-b28e-d2b0b9e8e263 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:41.976594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:41.977259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:41.977593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:41.977873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:42.048330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:42.049814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:42.089168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:42.155343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:42.156750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:42.187282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:42.265768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2a035-a0e1-453f-8a21-72fd2fdb57a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:42.319620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:42.320933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:42.321438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:42.321908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:42.323342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:42.325015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05434bd-4fb3-4662-9227-78834f3ae89a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:42.328280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 144/293] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:42 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:42.333372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:42.434136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7333f-9c87-47fd-a0dd-2e7cdc70ba92 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:42.468535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:42.469612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:42.470157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:42.470624 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:42.471713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=cbe647d923d84338bd19bbd2aeae7a91) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:42.472220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:42.473863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee960-68f9-4ae5-a960-077a58d82edd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:42.483849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 150/294] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:42 2022] GET /identity/v3/role_assignments?user.id=cbe647d923d84338bd19bbd2aeae7a91&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:42.984228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604558-085c-43c3-b00d-9cf5f4a246ab None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:42.984598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604558-085c-43c3-b00d-9cf5f4a246ab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:42.984797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5604558-085c-43c3-b00d-9cf5f4a246ab None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:42.986440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 145/295] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:42.991934 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:42.992368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:42.992561 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:42.997609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.013043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:43.014289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:43.090020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:43.112171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5604558-085c-43c3-b00d-9cf5f4a246ab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.210177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.221247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5604558-085c-43c3-b00d-9cf5f4a246ab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.255944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.256808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.257087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.257359 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.267760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cde374f3-1cfc-4ec9-ae7d-3b1bb4fc4133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:43.275866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:43.276748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:43.277592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 146/297] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:43.283094 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.284684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb9a-e4f9-4128-b8b6-3a0e2b258b23 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.284973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb9a-e4f9-4128-b8b6-3a0e2b258b23 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.285346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb9a-e4f9-4128-b8b6-3a0e2b258b23 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.287209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 147/298] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:43.292365 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.292656 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.292937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.310138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:43.311334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:43.397009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b759-f22f-4c9f-a0a6-b4c63af97355 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.397574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 148/299] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:43.421490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.438850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.445573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.446286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.446570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.447018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.448234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:43.448546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:43.450364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:43.461028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 152/300] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:43.467021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.511767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.533146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aca21-7887-4d05-a999-ccbc972dd97e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.568784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.569596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.569878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.570282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.582901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:43.588850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf08e-a3f3-43bc-965f-0bb6e037aa1f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c96a7ec7-d631-469e-b9d4-a88f16de2c1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:43.594396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:43.595189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:43.596642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5da73-b252-4332-aaa5-9a21e7f538a5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.596807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5da73-b252-4332-aaa5-9a21e7f538a5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.597183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5da73-b252-4332-aaa5-9a21e7f538a5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.598745 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 150/302] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:43.602317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5da73-b252-4332-aaa5-9a21e7f538a5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.629383 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.630343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.630653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.630927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] PATH_INFO: `/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.632228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] RBAC: Authorizing `identity:get_user(user_id=7d10cf56d2274a0e8c251fdb2ea441e9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:43.633588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92de0-cb31-484e-9e6c-43094ad05d18 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:43.635334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 153/303] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:43.640898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.641165 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.641446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.657984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:43.659133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:43.714189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5da73-b252-4332-aaa5-9a21e7f538a5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.718943 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.731114 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 154/304] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:43.731956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.751886 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.752972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.753462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.754055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.755019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:43.755366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:43.756749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:43.765740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 151/305] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:43.771355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.774262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:43.850726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb124fad-c8fb-402b-84b3-47e580dfbc49 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.885270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afdaae-33c5-4e33-ab77-97160898b736 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:43.886706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.887580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.887858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.888128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] PATH_INFO: `/v3/system/users/7d10cf56d2274a0e8c251fdb2ea441e9/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.889622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7d10cf56d2274a0e8c251fdb2ea441e9, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:43.891061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:43.901402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 155/306] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 11 20:01:43 2022] PUT /identity/v3/system/users/7d10cf56d2274a0e8c251fdb2ea441e9/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:43.902166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.926340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:43.927596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:43.927880 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:43.928151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:43.929467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:43.931007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:43.933037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 152/307] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:43.939775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:43.986723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.033864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.045096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc483-9841-4ef3-97ab-777aa39bbec6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.070599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196636c-3d85-4558-9639-6db5b2498945 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.085458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.086434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.086728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.086995 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] PATH_INFO: `/v3/users/ba6ab4c1fb6c4740b114793d7be47c09` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.104061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] RBAC: Authorizing `identity:get_user(user_id=ba6ab4c1fb6c4740b114793d7be47c09)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:44.105661 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:44.107866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 156/308] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:43 2022] GET /identity/v3/users/ba6ab4c1fb6c4740b114793d7be47c09 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:44.108797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.109696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.110230 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.110694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] PATH_INFO: `/v3/groups` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.111595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:44.113285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:44.113545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307617-62e5-4666-8ead-c366af944bd6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:44.132799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 153/309] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 11 20:01:43 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:01:44.156751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6ab4-5ce9-45c1-96dc-f492464c7768 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.157608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6ab4-5ce9-45c1-96dc-f492464c7768 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.158150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6ab4-5ce9-45c1-96dc-f492464c7768 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.160331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 154/310] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:44.165901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.166911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.167127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.193843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:44.195082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:44.250693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de6a1-5f07-4d5b-8b0e-1e35ff3caa1f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.273859 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.279729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 155/311] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:44.299461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.299822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:44.300684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.301156 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.301621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.303848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, user.id=ba6ab4c1fb6c4740b114793d7be47c09, scope.system=all) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:44.304180 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:44.305923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:44.311726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 157/312] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 11 20:01:44 2022] GET /identity/v3/role_assignments?user.id=ba6ab4c1fb6c4740b114793d7be47c09&scope.system=all&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:44.377205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.424428 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e1e-5607-4a6f-af13-64ac3bef5677 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.461044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.461771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.462064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.462346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.473693 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:44.481862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:44.482800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:44.483592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:44.491191 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:44.599855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e432-698d-45df-8a16-6771119ca47c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.634744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.635416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.635691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.635960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.636703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:44.637004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:44.638561 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:44.647551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 158/314] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:44.653143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:44.757439 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa8e2-becc-471b-9243-26e7fb1af9d6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.778240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.792308 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.793201 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.793483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.793757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] PATH_INFO: `/v3/users/90d236bc229b41b594eb2b474ac788b1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:44.795013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=90d236bc229b41b594eb2b474ac788b1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:44.796475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:44.798455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 157/315] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:44 2022] GET /identity/v3/users/90d236bc229b41b594eb2b474ac788b1 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:44.803838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:44.865119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:44.913285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016537-30a4-4b57-a05e-27092aa78aeb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:44.948493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:44.949495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:44.949971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:44.950514 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:45.018743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:45.020638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:45.062420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:45.124023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:45.129906 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:45.231628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d031c-9adf-41e4-8d88-ac92f983a0e9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:45.268428 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:45.269368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:45.269586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:45.269858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:45.271215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:45.272674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffda2-76ce-44d6-8636-de1913351af9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:45.274804 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 158/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:45 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:45.280487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:45.380685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b6f-47de-4ace-b0a8-3938768fff26 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:45.418599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:45.419671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:45.420154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:45.420642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:45.421726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, scope.project.id=6a2ca8fdef584c23af23189aa580797a, user.id=90d236bc229b41b594eb2b474ac788b1) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:45.422275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:45.423937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb4b9f-2c19-4046-a165-c2a5bb6a7ca2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:45.431255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 160/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:01:45 2022] GET /identity/v3/role_assignments?user.id=90d236bc229b41b594eb2b474ac788b1&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:46.035227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122632-9afb-41e2-8827-c00cda555c80 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.035783 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122632-9afb-41e2-8827-c00cda555c80 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.035783 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122632-9afb-41e2-8827-c00cda555c80 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.037374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 159/319] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:46.042426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea2103-a72a-40b6-8bd4-ea94896d2afb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.042720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea2103-a72a-40b6-8bd4-ea94896d2afb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.043006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea2103-a72a-40b6-8bd4-ea94896d2afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.050292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.061472 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ebea2103-a72a-40b6-8bd4-ea94896d2afb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:46.062694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ebea2103-a72a-40b6-8bd4-ea94896d2afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:46.132902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:46.155877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6122632-9afb-41e2-8827-c00cda555c80 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.224829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.280610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6122632-9afb-41e2-8827-c00cda555c80 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.314620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.315421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.315698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.315974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.323904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab91-a390-46fe-8d78-ddf1685b94db None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.324193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab91-a390-46fe-8d78-ddf1685b94db None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.324476 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab91-a390-46fe-8d78-ddf1685b94db None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.325839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 162/321] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:46.326579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:46.328987 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad86b-7e79-4721-b434-2018334b2378 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.329270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad86b-7e79-4721-b434-2018334b2378 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.329733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fad86b-7e79-4721-b434-2018334b2378 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.330838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 163/322] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:46.331867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.332141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.332421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-40e93e66-cf1d-40d4-b6ca-775ad8ddbda0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:46.334802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:46.335756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:46.336552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 160/323] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:46.339348 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.339635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.339915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.352880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:46.354092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:46.356071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:46.357230 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:46.419579 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:46.420332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.421259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 161/325] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:46.441361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.481865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.486235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.520850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9321-a0b5-4ca1-8b63-72a7f1193725 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.540678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc954c-9b34-4c0d-8016-d677bcc38b6a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.557049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.558277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.558529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.558797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.559546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:46.560035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:46.562338 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:46.571981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:46.572759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.576669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.577381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.577628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.577903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.588110 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:46.595827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:46.596712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:46.597601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 162/327] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:46.600829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.673741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdfca-ee9b-482c-97e1-5c8a6b9b6a1c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.694787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924f6e-5e84-41a1-8728-1d06a0ddc540 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.698564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.701802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.708353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.709155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.709479 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.709754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.711326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:46.712834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:46.714633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 166/328] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:46.715230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.732725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.733700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.733993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.734304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] PATH_INFO: `/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.735512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=7d10cf56d2274a0e8c251fdb2ea441e9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:46.736982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:46.738656 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/users/7d10cf56d2274a0e8c251fdb2ea441e9 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:46.739403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.821718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33df51-5db2-4b68-9bdc-ebd60aa82f68 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7250ac6-be99-464d-97b2-7bafb1522ef7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:46.857828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.858545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.858819 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.859091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.859845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:46.860177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:46.861557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:46.869563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:46.870366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.875626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:46.876308 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:46.876595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:46.876872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] PATH_INFO: `/v3/groups` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:46.877581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:46.879054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:46.893727 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 164/331] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 11 20:01:46 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:01:46.894601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:46.940411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.949104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:46.990740 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0ba3e-f590-4e9d-887a-8753a6b08e16 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:47.024325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494e89-3680-43d9-a884-c5c49ee7f5c7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:47.028445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:47.029219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:47.029567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:47.029844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:47.030725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] RBAC: Adding query filter params (role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, user.id=7d10cf56d2274a0e8c251fdb2ea441e9, scope.system=all) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:47.031035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:47.032570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:47.045952 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/role_assignments?user.id=7d10cf56d2274a0e8c251fdb2ea441e9&scope.system=all&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:47.063236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:47.064163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:47.064450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:47.065255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] PATH_INFO: `/v3/users/ba6ab4c1fb6c4740b114793d7be47c09` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:47.066852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] RBAC: Authorizing `identity:get_user(user_id=ba6ab4c1fb6c4740b114793d7be47c09)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:47.067766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d2842-c779-4647-abea-55ad300ee5ab None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:47.069526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:46 2022] GET /identity/v3/users/ba6ab4c1fb6c4740b114793d7be47c09 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:47.075454 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:47.190862 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e580816-b3e7-4e06-9187-5afe02ebc706 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:47.209651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:47.235541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:47.236777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:47.237279 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:47.237742 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] PATH_INFO: `/v3/system/users/ba6ab4c1fb6c4740b114793d7be47c09/roles/296c91cf1c8a4e8e856b1970cd0dd3bb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:47.239565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba6ab4c1fb6c4740b114793d7be47c09, role_id=296c91cf1c8a4e8e856b1970cd0dd3bb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:47.241177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e4a6d-4d67-44f4-9cc7-46d0a2015ee2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:47.251098 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 11 20:01:47 2022] PUT /identity/v3/system/users/ba6ab4c1fb6c4740b114793d7be47c09/roles/296c91cf1c8a4e8e856b1970cd0dd3bb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:49.365083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db74b8-dafa-45bf-9f68-a97b4035f0b5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.366121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db74b8-dafa-45bf-9f68-a97b4035f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.366605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db74b8-dafa-45bf-9f68-a97b4035f0b5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.368481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:49.373540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf212e-c523-4110-89a2-08cefa270a5a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.373939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf212e-c523-4110-89a2-08cefa270a5a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.374128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf212e-c523-4110-89a2-08cefa270a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.398160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0abf212e-c523-4110-89a2-08cefa270a5a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:49.399371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0abf212e-c523-4110-89a2-08cefa270a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:49.483406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:49.510303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db74b8-dafa-45bf-9f68-a97b4035f0b5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:49.596332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0217a6-5e90-4b46-9fde-a6fc1378da1a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.596661 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0217a6-5e90-4b46-9fde-a6fc1378da1a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.596890 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0217a6-5e90-4b46-9fde-a6fc1378da1a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.598543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 171/337] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:49.604017 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.604376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.604660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.622183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:49.623298 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:49.673388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db74b8-dafa-45bf-9f68-a97b4035f0b5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:49.675098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:49.735842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:49.736658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.736929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.737209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.743283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:49.755729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:49.765501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:49.766502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:49.767289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:49.771318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 167/339] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:49.777301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:49.823823 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:49.836174 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:49.916608 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b7eb7-4d5a-4868-949c-e5648a782654 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:49.988802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:49.989511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:49.989971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:49.990297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:49.991059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:49.991368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:49.992753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612ae1-03f0-47bf-b4a8-5d0b3431fd45 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:50.002562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 173/340] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:50.003751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fbf10-bcaa-486b-88d8-96f3756e4c5f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.003984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fbf10-bcaa-486b-88d8-96f3756e4c5f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.004333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fbf10-bcaa-486b-88d8-96f3756e4c5f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.005800 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 174/341] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:50.010101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fbf10-bcaa-486b-88d8-96f3756e4c5f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.053906 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60494b-fe32-430c-b70d-9785a2689225 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.108634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.109449 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.109730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.110003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.123028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-719b3c23-b938-4f3d-bb25-8fef3a109afb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:50.131222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:50.132177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:50.132979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 168/342] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:50.133809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e0b1-8a7b-4544-a340-bd6e11d3c118 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.135931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e0b1-8a7b-4544-a340-bd6e11d3c118 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.135931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e0b1-8a7b-4544-a340-bd6e11d3c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.136124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.142395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fbf10-bcaa-486b-88d8-96f3756e4c5f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.155782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a167e0b1-8a7b-4544-a340-bd6e11d3c118 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:50.157007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a167e0b1-8a7b-4544-a340-bd6e11d3c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:50.180982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.189547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.190573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.191007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.191400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.246527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 169/343] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:50.251395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570581-90f6-4a8f-adb8-112062599071 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.251684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570581-90f6-4a8f-adb8-112062599071 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.251959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570581-90f6-4a8f-adb8-112062599071 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.253407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 170/344] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:50.253957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5570581-90f6-4a8f-adb8-112062599071 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.295198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:50.296839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fc1c-8dd8-4768-af19-81b0d4cb753c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:50.393506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5570581-90f6-4a8f-adb8-112062599071 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.419147 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.426216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 175/345] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:01:50.427588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.428639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.428919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.442470 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.443283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.443565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.443840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.444660 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:50.444974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:50.446425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:50.448962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:50.450207 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:50.458608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 171/346] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:50.459462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.477672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.535250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 176/347] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:50.536250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.585485 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be947-b3a7-4d1d-8ab1-9c55c58f9397 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.640851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.641680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.641965 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.642281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.657229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:50.664610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f07a-8263-438b-b089-d1bebb7c4a74 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:50.666478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:50.667820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:50.669057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 172/348] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:50.678064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.700254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.709510 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.710521 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.710900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.711180 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.712441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:50.714791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:50.716690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 177/349] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:50.717371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.763590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:50.791194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81cb9d-e65a-466d-ac5e-fdb7d0a6df43 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.829844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.830620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.830975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.831321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.831709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007620a-f043-4c7e-a0e6-0243c5154325 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:50.874653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:50.875539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:50.875826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:50.876136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:50.896774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:50.914164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:50.915084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:50.915869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:50.916459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 178/350] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:50.917291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:50.917396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:50.918702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:50.992123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.007411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.042545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e485-0102-4ac7-a7ab-837ed62bdaa4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.044921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 173/351] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:51.045802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.091676 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.092370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.092653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.092937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.093702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:51.094015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.095737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.105649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 179/352] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.106537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.171217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02330d12-443f-405a-b013-7f701bdfd0bf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.211957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.212833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.213130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.213388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.221865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.223409 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f015d7-19bd-47f8-ae3a-156c49ab8a8f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.225495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 174/353] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.226793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1c43a-f3e2-43e4-8d36-b8af45bf08a3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.227111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1c43a-f3e2-43e4-8d36-b8af45bf08a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.227352 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1c43a-f3e2-43e4-8d36-b8af45bf08a3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.231267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7be0-3591-4a6a-9cec-8f29fefb9aa7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.232976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 175/354] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:51.233776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1c43a-f3e2-43e4-8d36-b8af45bf08a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.254307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.270886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.271949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.272447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.272726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.273492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:51.273804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.275222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.283953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 180/355] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.284795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.286494 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.358770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1c43a-f3e2-43e4-8d36-b8af45bf08a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.397689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.398694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.399159 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.399436 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.400620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.401254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6503-98bd-4bcb-9afa-09dd822945c4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.402097 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bbd42-5d22-491c-b2d2-d230bb895190 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.403815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 176/356] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.405017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed233b-1ac1-4050-9500-bf3e4b539d58 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.405301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed233b-1ac1-4050-9500-bf3e4b539d58 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.405576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed233b-1ac1-4050-9500-bf3e4b539d58 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.411610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 177/357] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:51.412412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed233b-1ac1-4050-9500-bf3e4b539d58 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.441200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.442199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.442486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.442794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] PATH_INFO: `/v3/users/ba6ab4c1fb6c4740b114793d7be47c09` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.443996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] RBAC: Authorizing `identity:get_user(user_id=ba6ab4c1fb6c4740b114793d7be47c09)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.445453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff5edd-60ec-4468-b2fa-e65a08ab38c7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.447595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 181/358] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/users/ba6ab4c1fb6c4740b114793d7be47c09 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.448857 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.449142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.449422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.466169 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:51.467389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:51.522389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.542437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed233b-1ac1-4050-9500-bf3e4b539d58 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.549331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 182/359] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:51.549797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.552110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.586401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.587070 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.587350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.587623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.588499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=4cee93e7c9664996813c5c7b5e681e88) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:51.588822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.590325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.596736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 178/360] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.598783 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.696091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4506-323a-4af1-ac9d-66f0666811c9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.739980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8adc7-cf99-46e6-8ad2-833f8d05f69e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:51.743529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.744223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.744504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.744777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.784394 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:51.785555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.785836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.786463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.787918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.790002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a898aa-84ea-42ae-b930-6cb9e2827ae0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.793189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 179/361] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:51.794552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:51.794837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:51.795115 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:51.808727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.815640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:51.816848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:51.842943 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:51.844444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:51.857543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:51.904822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:51.905552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:51.965005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 183/363] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:51.965875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.037022 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ad76-15f3-4674-83a4-38ffb255cde4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.070766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.084285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.084902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.085327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.085601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.090866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] RBAC: Adding query filter params (role.id=296c91cf1c8a4e8e856b1970cd0dd3bb, user.id=ba6ab4c1fb6c4740b114793d7be47c09, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:52.090866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.090866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.091392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727776-edb8-406f-96ad-24cb050afc18 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.103685 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/role_assignments?user.id=ba6ab4c1fb6c4740b114793d7be47c09&scope.system=all&role.id=296c91cf1c8a4e8e856b1970cd0dd3bb => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.104835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.140538 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.141421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.141724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.142554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.151282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.161150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:52.173243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:52.174257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:52.175052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:52.175666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:52.176869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.258363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9b5-3264-4f9e-8e3f-6a56704544a8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.298972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.299562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.299840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.300108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.300950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=6a2ca8fdef584c23af23189aa580797a) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:52.301259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.302986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.309774 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.312073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.319425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9af8-343a-4cf7-a7a4-04c61255c14a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.371828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.372657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.372927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.373193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.382063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.386901 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:52.396091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:52.397053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:52.397838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:52.399163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.432136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.445945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e09c5-721d-4461-8a7c-cb23c8bfa1ab None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.496018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.496937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.497224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.497500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.498732 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.500313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.503589 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.504413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.532243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337d96-d1e8-4646-a8a8-1075234c0b3f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.583924 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.584635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.584916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.585209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.594131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:52.594131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.594131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.601054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.602485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.641887 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1848c-e5d8-467d-9471-5547a463704d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.678402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.679088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.679368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.679642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.679968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.680398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:52.680703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.682092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.691432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 184/370] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.692326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.717325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198bb6f-5b62-45d3-912e-b37ffe97d8ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.725411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.759162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.760381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.760669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.760946 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.762243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.763801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.766611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 187/371] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:52.767641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:52.822201 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716512c-0856-4827-977d-4a0fe8be556e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.863131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.863787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.864067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.864341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.890802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccab30-f3bf-4d04-ba3b-cafa03c7247d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:52.921080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:52.929229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:52.929947 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:52.930280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:52.930559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:52.946989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:52.948562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:52.971486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.003306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.004803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.064976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:53.065844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.114045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:53.114910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.146855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.186971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2daa-ed27-47c5-9a9d-6fff0da2ea3d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.208158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.225569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc6db-5e04-423c-9ac7-0cf5765581e9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.225941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.226653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.226939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.227222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.228079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=4cee93e7c9664996813c5c7b5e681e88) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:53.228399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.229871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.236977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.237833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.285867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.286889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.287173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.287448 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.288776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.290277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.292006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 189/375] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.303134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.351849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada89d9-dbd6-4676-bc59-9758fc28c85e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.423244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.424050 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.424339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.424617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] PATH_INFO: `/v3/projects/baf222b77c1c4150a568d9f632f18818` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.425851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] RBAC: Authorizing `identity:get_project(project_id=baf222b77c1c4150a568d9f632f18818)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.427392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.429445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/projects/baf222b77c1c4150a568d9f632f18818 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.435249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.493443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.523921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.537462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691caf0c-ef9b-473a-872a-ed592555cce3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.545403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbc69e-7d7c-4573-b7de-69e4e3a4cd75 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.581180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.586056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.586056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.586056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] PATH_INFO: `/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.588154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] RBAC: Authorizing `identity:get_group(group_id=6d5df9a7b5aa44be8f147b7f7b0f682e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.589648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.591768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:53.597711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.615715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.616845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.617291 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.617701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.619058 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.620662 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.626015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 190/378] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.655097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:53.714141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc4cf-4c66-4607-9299-c4aae491e23e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.756257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:53.803679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7ac3-1e86-44a6-af0b-ae24aa741ff5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:53.840723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.842010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.842407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.842523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:53.842860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.843137 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.843403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.843677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.844122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] RBAC: Adding query filter params (group.id=6d5df9a7b5aa44be8f147b7f7b0f682e, role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=baf222b77c1c4150a568d9f632f18818) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:53.844525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=6a2ca8fdef584c23af23189aa580797a) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:53.844807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.844910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:53.846357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df597-576e-4729-954b-c58806d0f505 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.847482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894d96-675c-4363-8ffa-be69067a5800 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:53.854505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 191/379] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.868224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 189/380] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:53 2022] GET /identity/v3/role_assignments?group.id=6d5df9a7b5aa44be8f147b7f7b0f682e&scope.project.id=baf222b77c1c4150a568d9f632f18818&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:53.877171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d0e5-eb1e-4b58-899c-749eea55e8e0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.877511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d0e5-eb1e-4b58-899c-749eea55e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.877740 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d0e5-eb1e-4b58-899c-749eea55e8e0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.879440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 192/381] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:53.887046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:53.887384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:53.887614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:53.909348 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:53.910662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:54.025413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 190/382] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:54.063492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d0e5-eb1e-4b58-899c-749eea55e8e0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:54.108525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:54.189022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d0e5-eb1e-4b58-899c-749eea55e8e0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:54.224080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:54.224898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:54.225185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:54.225461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:54.236711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:54.244629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:54.245645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:54.246738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 193/383] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:54.251935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:54.390197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b5bbc-7dee-49b2-9fa6-b2e6fdc9ec7a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:54.401849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:54.427459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:54.428136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:54.428406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:54.428671 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:54.429429 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:54.429731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:54.431163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:54.441451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 191/384] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:54.446641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:54.558315 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:54.569292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068202-51c8-446a-8217-2c368825c6a5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:54.607117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:54.607983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:54.608259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:54.608529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:54.609754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:54.611224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:54.615398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 194/385] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:54 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:54.618354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:54.740062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9091-6de7-44cd-b9c0-60b207daf930 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:54.777726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:54.778630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:54.778910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:54.779183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:54.782749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:54.784204 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81cc23-2b38-4847-a04b-aea7ff33dbbb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:54.786305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 192/386] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:54 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:54.791675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:54.909741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb19d-b96a-4c57-baba-e1874712fefb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:54.953009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36b108-2415-442c-b053-54845a910881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:54.953899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36b108-2415-442c-b053-54845a910881 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:54.954213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36b108-2415-442c-b053-54845a910881 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:54.954485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36b108-2415-442c-b053-54845a910881 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/groups/17775c45b5984236834a58a89400e2dc/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:54.959299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36b108-2415-442c-b053-54845a910881 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, group_id=17775c45b5984236834a58a89400e2dc, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:54.960747 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36b108-2415-442c-b053-54845a910881 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:54.977922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 195/387] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 11 20:01:54 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/groups/17775c45b5984236834a58a89400e2dc/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:55.246665 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ddb6-cdcc-4342-afc0-4a38f44073da None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.247351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ddb6-cdcc-4342-afc0-4a38f44073da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.247848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ddb6-cdcc-4342-afc0-4a38f44073da None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.249705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 193/388] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:55.254752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.255346 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.255833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.273837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:55.275437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:55.293254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:55.366821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 196/389] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:55.400734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ddb6-cdcc-4342-afc0-4a38f44073da None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:55.452911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:55.529902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ddb6-cdcc-4342-afc0-4a38f44073da None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:55.572671 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:55.573898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.574467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.574939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.591181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-83990d74-e029-4c56-9d81-6084c7504fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:55.599507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:55.600460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:55.601242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:55.603637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 194/390] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:55.609707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:55.671790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777bec-16d8-4713-894a-d2ab882c7ab8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.672444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777bec-16d8-4713-894a-d2ab882c7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.672922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c777bec-16d8-4713-894a-d2ab882c7ab8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.674803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 195/391] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:55.679928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.680221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.680509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.707666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:55.710884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:55.769819 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c352-bcbc-4ef9-9eeb-ac391feda18b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:55.829994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 196/392] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:55.844149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:55.845187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:55.845654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:55.846156 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:55.847101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:55.847594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:55.849507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:55.859888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 197/393] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:55.866821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:55.871042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:55.893582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:55.910563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:55.972702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540fbcf-5187-4746-92cf-a3b8a92742ce None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.007153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.008399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.008955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.009427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.010923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.012567 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.014833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 197/394] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:55 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:56.020082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.097036 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a54b-f81f-4d65-a476-c3e22ab8b775 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.144226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.150425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4033-714b-4e10-b8c4-5ddb5c99ad1d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.168578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.169430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.169772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.170071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.190550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.192108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.192649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.193116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.194660 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.196312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.198703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 198/395] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:56.198961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:56.207345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:56.208316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:56.209105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:56.210953 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.211748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 198/396] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:56.217610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.294750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.327556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f596-a0c3-4172-a1e0-7b0659eae8a5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.347137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e750d-3a13-4c27-8e9a-b284fe4fbfa4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.365108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.366335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.366832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.367297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.368270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:56.368788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.370399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde983-60cd-4553-a4f7-8a672859efc2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.379724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 199/397] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:56.381441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d078a-a54f-49cc-9053-a984ce55a721 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.381940 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d078a-a54f-49cc-9053-a984ce55a721 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.382447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d078a-a54f-49cc-9053-a984ce55a721 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.384262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 200/398] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:56.388504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d078a-a54f-49cc-9053-a984ce55a721 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.391404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.392553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.393046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.393516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/groups/17775c45b5984236834a58a89400e2dc/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.395826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, group_id=17775c45b5984236834a58a89400e2dc, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.397614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ab9dd-e28d-475a-aab2-567c14087c0e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.413340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 11 20:01:56 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/groups/17775c45b5984236834a58a89400e2dc/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:56.415316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.415862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.416350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.436427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:56.438054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:56.463171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.499881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d078a-a54f-49cc-9053-a984ce55a721 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.522501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 200/400] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:56.554848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.563197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.564096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.564483 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.564703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.566056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.567640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.572357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 201/401] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:56.576143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.589441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.718089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203126ac-58b9-4aac-8151-0e571e1edac2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.725136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747c-cd8b-47b3-b383-af139751948c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.762155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.763159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.763565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.763860 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.765066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.766545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.769056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:56.775003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:56.826943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.827638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.827924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.828202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.850472 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.859509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2eaff956-0065-4432-a102-491df85fb261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:56.867992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:56.868974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:56.870196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 201/403] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:56.870852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd618-d5b9-42ca-a3de-d68f6892bb7a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.871219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd618-d5b9-42ca-a3de-d68f6892bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.872995 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd618-d5b9-42ca-a3de-d68f6892bb7a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.872995 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 202/404] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:56.879209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.880262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.880262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.885396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5508-7d0f-4995-ba35-76d1b34d15c5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:56.900164 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:56.901378 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:56.913883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:56.920972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:56.921873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:56.922185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:56.922460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88/groups/17775c45b5984236834a58a89400e2dc/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:56.924727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] RBAC: Authorizing `identity:create_grant(project_id=4cee93e7c9664996813c5c7b5e681e88, group_id=17775c45b5984236834a58a89400e2dc, role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:56.926204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:56.942603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 203/405] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 11 20:01:56 2022] PUT /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88/groups/17775c45b5984236834a58a89400e2dc/roles/d9bf441543c64c42a197b79c49c8b17e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:56.946389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.034085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 203/406] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:57.060177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.104981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52262c1-8909-4816-b202-216cbc6b74fb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.170468 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.181722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.183436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.184266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.184749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.186190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:57.186854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.188723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.192997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b0784-a63b-4d55-9ac4-01a3badca5b0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.200716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 204/407] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.208132 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.239903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.241362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.241749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.242120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.253797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:57.261959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:57.262893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:57.263673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 204/408] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:57.280759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.292710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.370265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b827-bd1e-4ba2-b9dd-343720bb384e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.439849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.442717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.443324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.444316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.447627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.449550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.456943 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 205/409] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.459050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.470885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574248f6-a363-4098-b162-48f50b87a3c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.514739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.515831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.516334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.516806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.517780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:57.518331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.519921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.530104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 205/410] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.536443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.547591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.590497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda4c5-e30a-4a4b-abc2-9641f27609e7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.612391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.635171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.636954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.637557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.638049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.640043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.642342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741fb87-554f-4e99-801b-7cfe05a4f518 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.645266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 206/411] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.647011 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816996c-1de4-4087-8ed7-af6704a97fa9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.647621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816996c-1de4-4087-8ed7-af6704a97fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.648095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816996c-1de4-4087-8ed7-af6704a97fa9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.648197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd411b5-101e-43be-a718-a1b5873c24c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.649936 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 207/412] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:57.650842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816996c-1de4-4087-8ed7-af6704a97fa9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.688701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.689687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.690011 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.690343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] PATH_INFO: `/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.691547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] RBAC: Authorizing `identity:get_group(group_id=6d5df9a7b5aa44be8f147b7f7b0f682e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.693020 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b05d6-1799-4e84-9172-8d61705270b2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.695170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.699777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.699777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.699777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.715873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:57.717189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:57.787341 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816996c-1de4-4087-8ed7-af6704a97fa9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.794155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 207/414] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:57.795080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.817928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.830210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.831368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.831870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.832339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a/groups/17775c45b5984236834a58a89400e2dc/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.835138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] RBAC: Authorizing `identity:create_grant(project_id=6a2ca8fdef584c23af23189aa580797a, group_id=17775c45b5984236834a58a89400e2dc, role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.837671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.858548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 208/415] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 11 20:01:57 2022] PUT /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a/groups/17775c45b5984236834a58a89400e2dc/roles/d9bf441543c64c42a197b79c49c8b17e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:01:57.861203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:57.897560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:57.937645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afcc35-7c6f-46b0-960d-980aec58694c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:57.975664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:57.976551 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:57.976829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:57.977102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] PATH_INFO: `/v3/projects/baf222b77c1c4150a568d9f632f18818` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:57.980762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] RBAC: Authorizing `identity:get_project(project_id=baf222b77c1c4150a568d9f632f18818)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:57.982287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:57.984427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 208/416] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/projects/baf222b77c1c4150a568d9f632f18818 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:57.990707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:58.008262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f69f2-d688-44fa-8858-76675ae7d74c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.043424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:58.044379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.044850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.045116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.056558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:58.065001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:58.065965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:58.066792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 209/417] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:58.073071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:58.110476 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824b0a-d83e-44a2-bed0-3a0756bbfe36 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.122096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:58.153101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:58.154389 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.154879 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.155328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] PATH_INFO: `/v3/projects/baf222b77c1c4150a568d9f632f18818/groups/6d5df9a7b5aa44be8f147b7f7b0f682e/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.157686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=baf222b77c1c4150a568d9f632f18818, group_id=6d5df9a7b5aa44be8f147b7f7b0f682e, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:58.159353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:58.162134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:58.177565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 209/418] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 11 20:01:57 2022] PUT /identity/v3/projects/baf222b77c1c4150a568d9f632f18818/groups/6d5df9a7b5aa44be8f147b7f7b0f682e/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:01:58.180960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608822b-c870-4661-9997-5d40f4d0a2a2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.219539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:58.220367 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.220648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.220919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.221687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:58.221996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:58.223446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:58.236025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 210/419] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:58.240062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:58.372592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1810f8e-d8ee-42f7-a46d-413dac055d86 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.409842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:58.410547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.410828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.411094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.478752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:58.488445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:58.490376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:58.612558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 210/420] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:01:58.618219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:58.739222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489cbb-1b4d-4902-9a68-2bc9ac381953 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.748561 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:58.774307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:58.775180 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.775458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.775730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.776916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:58.778385 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb9844-7211-41a4-99bb-9054ec84030a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:58.784564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 211/421] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:58 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:58.785958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:58.819705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3111-c45e-4dd8-8651-d1ee78bdc666 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.820349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3111-c45e-4dd8-8651-d1ee78bdc666 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.820349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3111-c45e-4dd8-8651-d1ee78bdc666 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.821877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 212/422] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:01:58.827112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:58.827392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:58.827677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:58.851808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:58.853198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:58.922829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 213/423] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:01:58.946628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:58.952316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801c019-28c1-44cc-a1fd-808a22466531 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:58.957882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.007037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.007829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.008113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.008388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.009586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:59.011084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:59.013034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 211/424] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:01:58 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:59.023490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.065904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460632-42d1-414e-a0d3-a3cb6499cf38 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.074749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.103200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.104012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.104387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.104715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.115838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:59.123854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:59.124734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:01:59.125528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:01:59.130851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.215802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0b9dc-9798-42c7-ad4d-019b68029c3e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.252113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.252777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.253054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.253322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.254184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=4cee93e7c9664996813c5c7b5e681e88) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:59.254629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:59.256638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9c8d-6a0b-49e4-93ed-92cdd2a914f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:59.268249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 212/426] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:59.350335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a2c-e6a1-4c8e-8736-8fec013dd143 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.402424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.403108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.403391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.403669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.404434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:59.404750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:59.406164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:59.414593 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aad1e-f543-4dac-9899-d8cc5c29ccf8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.415223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aad1e-f543-4dac-9899-d8cc5c29ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.415711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aad1e-f543-4dac-9899-d8cc5c29ccf8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.417544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 213/427] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:01:59.421291 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:01:59.422725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.423223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.423438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.423992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.441311 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:01:59.442978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:01:59.466160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.472364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.534882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 214/429] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:01:59.560601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa505-b29b-49e6-88f4-7d117557164d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.562476 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.623632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.624296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.624580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.624854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.699393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a92848-d4a1-4030-bc74-8a3a4d8f37e6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.705057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:59.706876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:59.736647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.736988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.737815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.738129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.738410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.751946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:01:59.761432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:01:59.762417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:01:59.763195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 215/430] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:01:59.771305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.799218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.823642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:01:59.831175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.917354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b315-addd-43f3-b9de-a5a7fae41097 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.947676 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01c44-82e0-46a7-ac13-19d561505675 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:01:59.960392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.961081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:01:59.961366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:01:59.961644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:01:59.962440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:01:59.962751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:01:59.965049 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:01:59.976390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:01:59.981793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:01:59.986253 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:01:59.998438 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:01:59.999633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.000114 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.000584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.002013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.005436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.007837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 217/433] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:00.012965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.084259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.113365 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde08d1-d57c-4dfe-9ef4-be086de9fb33 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.129679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a609-e0f1-45db-b046-3bb1110c81f9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.157669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.158634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.158921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.159199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.169854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.171067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.171596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.172066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.173498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.175188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.177419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:00.183129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.256102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.258299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ff46-7830-4181-b7d3-d966b732a130 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.263848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.312669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370a91d-bf73-44d9-b2c1-d887c7823b77 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.349026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.350022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.350538 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.351033 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.352067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=034b96f9c53f43fe8c7be9cf9ad10bbe, scope.project.id=6a2ca8fdef584c23af23189aa580797a) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:00.352637 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.354341 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.360282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.361407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 219/435] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=034b96f9c53f43fe8c7be9cf9ad10bbe => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:00.393564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 217/436] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:00.399386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.522331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f71a7c-7dd6-45ca-9f3e-639341c6b20e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.544228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68c93d-e63b-4f38-a81f-ce4541d8415d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.544746 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68c93d-e63b-4f38-a81f-ce4541d8415d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.544746 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68c93d-e63b-4f38-a81f-ce4541d8415d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.549906 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 218/437] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:02:00.550598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.552101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.552444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.552717 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.569428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.570336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.570616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.570893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] PATH_INFO: `/v3/projects/4cee93e7c9664996813c5c7b5e681e88` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.572113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] RBAC: Authorizing `identity:get_project(project_id=4cee93e7c9664996813c5c7b5e681e88)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.572407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:00.573563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.573691 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:00.575832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 220/438] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/projects/4cee93e7c9664996813c5c7b5e681e88 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:00.583056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.645185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 219/439] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:00.668064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.688931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b150-f9a1-4ba2-a9fe-c9bdc711ac44 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.727311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.728191 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.728474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.728757 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.729991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.731504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.737894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 221/440] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:00.738718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.774456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ae5c-e6ae-450f-8ce8-1d112f5c1783 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.785733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.808688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:00.822102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.822935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.823213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.823492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.834314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f9f5123e-b487-4027-9056-513d5d28f368 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:00.842606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:00.843579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:00.844500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:00.845637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082932d-8396-487b-9a2a-b1c781bca02c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.845637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082932d-8396-487b-9a2a-b1c781bca02c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.845637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082932d-8396-487b-9a2a-b1c781bca02c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.846805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 221/442] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:00.849602 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082932d-8396-487b-9a2a-b1c781bca02c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:00.853547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416479d-64d3-4df0-9a99-76c7c6e0b73d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.886785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326433-5334-4e08-a349-682206abaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.887460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326433-5334-4e08-a349-682206abaaff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.887727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326433-5334-4e08-a349-682206abaaff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.888003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326433-5334-4e08-a349-682206abaaff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.888832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42326433-5334-4e08-a349-682206abaaff None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=4cee93e7c9664996813c5c7b5e681e88) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:00.889149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42326433-5334-4e08-a349-682206abaaff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:00.890629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42326433-5334-4e08-a349-682206abaaff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:00.905297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=4cee93e7c9664996813c5c7b5e681e88&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:00.905297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.905297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.905297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.921548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:00.922850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:00.957395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082932d-8396-487b-9a2a-b1c781bca02c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:00.995181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:00.995858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:00.996143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:00.996415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:00.997184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:01.010067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.010304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 223/444] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:01.010397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.018708 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 222/445] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:01.023089 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.024426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.060294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.098222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.143947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c7472-2443-4e6c-bfdb-92302d3031e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.145284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6ceb-f8d4-403f-9855-917d7aaf0fdf None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.181408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.181990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.182309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.182587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.187244 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.188142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.188331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.189125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.200019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:01.208815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:01.209730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:01.210572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 224/446] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:01.216032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.263245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.264755 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.300798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.334666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52704-99d8-4676-a283-c879ef54c06a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.355970 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.373819 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.374565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.374834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.375115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.375884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:01.376199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.377619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.386762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 225/447] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:01.391050 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 223/448] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:01.392601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.397279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.495754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1297e0f-d454-4294-b58f-107b98437161 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.498549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8f817-256a-4d5e-9455-ad496ba56449 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.525442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.528986 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.529784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.530140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.530511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.532083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.532959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.533283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.533520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] PATH_INFO: `/v3/projects/6a2ca8fdef584c23af23189aa580797a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.534713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a2ca8fdef584c23af23189aa580797a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.536223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.537914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/projects/6a2ca8fdef584c23af23189aa580797a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:01.543360 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.580661 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.601795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.603307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.645224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8b8ce-af7f-4a5c-87ee-df4a988746c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.679344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.680203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.680480 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.680757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] PATH_INFO: `/v3/groups/17775c45b5984236834a58a89400e2dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.681945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] RBAC: Authorizing `identity:get_group(group_id=17775c45b5984236834a58a89400e2dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.683725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.685354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/groups/17775c45b5984236834a58a89400e2dc => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:01.691443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.700528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 226/451] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:02:01.705974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.762435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.790269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:01.806324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4919-c8a6-43c1-acbf-161bab282cb1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.810806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799821ce-74d3-41bc-af02-a08087acc977 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.841551 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.842232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.842511 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.842789 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.843612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] RBAC: Adding query filter params (group.id=17775c45b5984236834a58a89400e2dc, role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=6a2ca8fdef584c23af23189aa580797a) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:01.843926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.845363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.848409 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:01.849301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:01.849582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:01.849855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] PATH_INFO: `/v3/projects/baf222b77c1c4150a568d9f632f18818` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:01.851097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] RBAC: Authorizing `identity:get_project(project_id=baf222b77c1c4150a568d9f632f18818)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:01.851211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 226/452] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/role_assignments?group.id=17775c45b5984236834a58a89400e2dc&scope.project.id=6a2ca8fdef584c23af23189aa580797a&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:01.852629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:01.854354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/projects/baf222b77c1c4150a568d9f632f18818 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:01.860177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:01.967737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63e1b-6568-4958-a106-91a7f27e9e4e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:01.999499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:02.006234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:02.007122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:02.007423 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:02.007684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] PATH_INFO: `/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:02.008899 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] RBAC: Authorizing `identity:get_group(group_id=6d5df9a7b5aa44be8f147b7f7b0f682e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:02.010367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46940650-cba3-474f-a164-9ba6c72d4851 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:02.012014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 11 20:02:01 2022] GET /identity/v3/groups/6d5df9a7b5aa44be8f147b7f7b0f682e => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:02.018343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:02.126355 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb550-885f-4a6f-9d98-a74b522636a0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:02.159851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:02.160506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:02.160789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:02.161093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:02.161962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] RBAC: Adding query filter params (group.id=6d5df9a7b5aa44be8f147b7f7b0f682e, role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=baf222b77c1c4150a568d9f632f18818) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:02.162305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:02.163761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ed8f-d4e8-413b-9ede-40f7f6222f76 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:02.169671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 11 20:02:02 2022] GET /identity/v3/role_assignments?group.id=6d5df9a7b5aa44be8f147b7f7b0f682e&scope.project.id=baf222b77c1c4150a568d9f632f18818&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:04.584153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75110-18f3-4fb2-b876-9b2029f0b0c4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:04.584675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75110-18f3-4fb2-b876-9b2029f0b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:04.584675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75110-18f3-4fb2-b876-9b2029f0b0c4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:04.586079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:04.599605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:04.600056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:04.600131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:04.623024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:04.624209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:04.632280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:04.711732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:04.738729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75110-18f3-4fb2-b876-9b2029f0b0c4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:04.869739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75110-18f3-4fb2-b876-9b2029f0b0c4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:04.917447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:04.918285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:04.918563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:04.918839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:04.929807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:04.935479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9c0a1704-bc60-4bb4-adc4-7ad46138cdc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:04.958506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:04.959418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:04.960267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:04.960267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:04.960267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:04.960267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:04.960267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 229/458] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:04.966778 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.035683 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169751a-f4b4-4cd2-a344-d9e12967dc68 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.035974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169751a-f4b4-4cd2-a344-d9e12967dc68 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.036722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169751a-f4b4-4cd2-a344-d9e12967dc68 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.038330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 230/459] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:05.039633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c347d7-6059-4265-b296-e226f6420330 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.040138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c347d7-6059-4265-b296-e226f6420330 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.040608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c347d7-6059-4265-b296-e226f6420330 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.042072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 231/460] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:05.044703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18438b-9bbd-4e60-8a44-3c1f381ab9dc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.045330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18438b-9bbd-4e60-8a44-3c1f381ab9dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.045823 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18438b-9bbd-4e60-8a44-3c1f381ab9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.067530 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fc18438b-9bbd-4e60-8a44-3c1f381ab9dc None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:05.069696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc18438b-9bbd-4e60-8a44-3c1f381ab9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:05.095840 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38beba-5baf-4b73-a6c7-da3981da479a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.130089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.134124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.135489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.136631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.137794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.138721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:05.139197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.140732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.158986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 232/461] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:05.161248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.161544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.161822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.163871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 230/462] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:05.169559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.172672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.183896 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:05.185475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:05.262066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 233/463] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:05.262066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.306225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba2b80-4f05-43e2-a00c-ab3dd5c91651 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.346967 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.348650 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.349426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.350200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.351104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.352939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.358302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f8877-3321-4fd7-9786-1d5e5a3f9d10 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.370160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.376705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 231/464] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:05.383568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.405663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.407182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.407512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.407982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.423776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.425572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d104c5af-5cc0-47b9-97d4-fb47c01bb4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:05.452398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:05.453331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:05.454221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:05.454221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:05.454221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:05.454221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:05.454221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 234/465] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:05.455430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28086c-c9a9-4a18-af77-d1eb7c952ff3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.455711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28086c-c9a9-4a18-af77-d1eb7c952ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.456035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28086c-c9a9-4a18-af77-d1eb7c952ff3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.458116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 235/466] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:05.463065 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28086c-c9a9-4a18-af77-d1eb7c952ff3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.472033 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.525893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475935-9d3d-46e7-a46a-9360e6506b39 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.571007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.571826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.572121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.572390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.587948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.589440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.594542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28086c-c9a9-4a18-af77-d1eb7c952ff3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-70f36ed3-9b5b-4742-b5c7-d99586c1893f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:05.608981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:05.610238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:05.611083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:05.611083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:05.611083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:05.611083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:05.611083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 232/467] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:05.611808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.612112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.615963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.635337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:05.636471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:05.641445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.642384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.642866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.643344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.644350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:05.644859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.646566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.659749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 236/468] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:05.660822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.701458 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.716364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 233/469] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:05.717511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.760125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:05.803931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c65a-0feb-4ec8-8f65-80ffcf3355b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.829174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed0e16-bcd5-4ddc-a7cf-26f2eff477e3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:05.849598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.850546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.851114 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.851541 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.852552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:05.853019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.854594 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.868565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 237/470] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:05.869666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:05.875867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:05.877590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:05.877948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:05.878336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:05.879124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:05.880722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:05.910871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 234/471] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:05.914738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.038076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:06.038608 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:06.049921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81132-49a4-4abe-b1e1-90d537c4f47e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.062658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d876c6-f732-4d6f-ba74-ff4c1886df7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.104231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.104919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.105210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.105485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.106236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.107303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.107769 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb674c3-48d4-4734-baed-bed6a3fa21ba None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.108269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.108557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.108835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.121914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.123725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.134996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 235/472] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:05 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:06.136379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58390-7565-4d62-83de-0b9f43599465 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.136666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58390-7565-4d62-83de-0b9f43599465 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.136993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58390-7565-4d62-83de-0b9f43599465 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.142807 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 236/473] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:06.144144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:06.144961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:06.146664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:06.146664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:06.146664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:06.146664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:06.146664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 238/474] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:06.148748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.149322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.149792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.151860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.174128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:06.176461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:06.273513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 237/475] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:06.276969 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050380-04ed-4ff3-a71c-b4e6942fac09 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.308350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.336313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.337341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.338407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.338877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.340101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:06.340601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.342833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.349570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:06.367252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 239/476] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:06.372869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.414491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:06.434147 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0121-a600-411a-a8a8-d18ca8e22103 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.474152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.475556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.476019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.476738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.477818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.479918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.481985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435b3b-c8f5-415c-9a95-7fdc65921464 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.486953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.sql.core [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:02:06.486953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 20:02:06.486953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [parameters: {'id': '61f6a6d879d34464b344022a98ca0d0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 20:02:06.486953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80499) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:06.509478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:06.510431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application yield resource Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise self.value Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application session.commit() Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:02:06.511368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:02:06.512219 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:06.513078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:06.513898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [parameters: {'id': '61f6a6d879d34464b344022a98ca0d0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:06.514717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 20:02:06.515488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.519195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 238/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 11 20:02:06 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:06.519195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.539370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.540054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.540336 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.540608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.541666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.543646 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.577672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 240/478] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:06 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:06.656612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130aa96-d026-4e46-9c47-289f3dce9026 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.708417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.709680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.710184 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.710673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.728430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e997fc83-5915-4e2d-9f99-9372a92dc648 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:06.737238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:06.738232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:02:06.739062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:06.742054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:06.747399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:06.810563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:06.864072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158bdfc-c7f0-409e-8f62-b7150967b0d2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:06.898160 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:06.898840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:06.899121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:06.899397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:06.900152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:06.900460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:06.901836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cb66f-14de-4e6b-8e1c-08440acb0841 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:06.910309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 241/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:07.731876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6e76-da30-47a0-b35f-e9b121dc2bae None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:07.732426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6e76-da30-47a0-b35f-e9b121dc2bae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:07.732426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6e76-da30-47a0-b35f-e9b121dc2bae None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:07.734065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 240/481] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:07.739699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:07.740301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:07.740779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:07.763361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:07.765373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:07.867000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:07.904902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6e76-da30-47a0-b35f-e9b121dc2bae None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:07.922959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.044532 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6e76-da30-47a0-b35f-e9b121dc2bae None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.090905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.091718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.092054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.092337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.110872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4e380109-10ed-4610-a9da-5e3ba98a8acf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:08.118753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:08.119660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:08.120458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 241/483] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:08.127165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.199053 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.274680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fa3ca-9699-479a-a5d3-2152f020eda4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.299770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6fe0-12e0-4130-ae07-2dbffb0de155 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.300036 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6fe0-12e0-4130-ae07-2dbffb0de155 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.300261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6fe0-12e0-4130-ae07-2dbffb0de155 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.302895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 242/484] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:08.307350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.307991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.308280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.330505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.330727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:08.331187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.331463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.331734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.331896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:08.332487 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:08.332962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:08.334554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:08.345876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:08.351522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.471722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.481385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19b02-94f4-47bd-82e9-8c7f527b452d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.484143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.484504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 243/486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:08.537900 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.538860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.539149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.539428 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.543107 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.562901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:08.564298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:08.589358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:08.590299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:08.591153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:08.591153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:08.591153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:08.591153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:08.593093 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 244/487] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:08.599385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.701535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbe08-1a69-4cc8-a0b5-6d55a6c78455 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.738587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.739485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.739770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.746100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.753336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:08.762293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:08.763198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:08.763978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:08.768536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:08.769818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.825237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff2826-2452-4d6f-a651-6fcf7ffd3485 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.835157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.883208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f045-2555-40d4-bd87-23aaed412542 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:08.899005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.899689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.899975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.900253 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.900991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:08.901305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:08.902725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb46e8-e07d-4168-8417-9968733a84db None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:08.915624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:08.916915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde276ef-5256-483a-b5ab-51bde9b38f40 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.917202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde276ef-5256-483a-b5ab-51bde9b38f40 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.917480 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde276ef-5256-483a-b5ab-51bde9b38f40 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.922821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 246/490] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:08.923604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde276ef-5256-483a-b5ab-51bde9b38f40 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:08.931064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:08.931754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.932043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.932328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.933933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:08.934280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:08.936148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a552857-21f1-4d40-b54d-0df617dd7c2a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:08.944634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:08.954013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 245/491] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:08.955924 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:08.956794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:08.957220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:08.979322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:08.981461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:09.035286 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde276ef-5256-483a-b5ab-51bde9b38f40 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.071468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.072443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.072837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.073234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 246/492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:09.074403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.078747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.095154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.096763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:09.121260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:09.122495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:09.123734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:09.130107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:09.130107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.139679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.194016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c175-c775-4941-96c2-df7768a9eae7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.219389 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.230449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.231256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.231536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.231808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.242048 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.243532 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.245966 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981943-d62d-4c91-9833-fc34c190361c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:09.262073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:09.262968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:09.263810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:09.263810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:09.263810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:09.263810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:09.263810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 247/494] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:09.264529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.288054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.288863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.289120 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.289426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.300912 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ee145974-15a7-4e3c-b509-053eb15563e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:09.309483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:09.310525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:09.311363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 248/495] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:09.312363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce828b-d861-4980-9783-e605df467716 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.312650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce828b-d861-4980-9783-e605df467716 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.312928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce828b-d861-4980-9783-e605df467716 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.318224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 249/496] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:09.318224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce828b-d861-4980-9783-e605df467716 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.372035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.375828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530003c0-e59d-4b05-a471-bc78bc944bb9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.410494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.411217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.411495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.411773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.412671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:09.412984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.414470 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.424499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce828b-d861-4980-9783-e605df467716 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.457103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:09.457103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.464658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.465460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.465776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.466131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.466962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:09.467338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.468735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd93f-f605-4a08-b623-097d0185957f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.471575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.482872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:09.488817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.489228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.489570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.506876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:09.508092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:09.558765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463cccd-f10a-4289-a370-3d8a64278a69 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.586060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 251/499] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:09.586060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.605852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.606641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.606981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.607322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.608250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:09.608721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.610299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.618683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 249/500] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:09.619594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.641796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.693777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02e91b-3fc2-41f4-b36d-9a9939c31ecd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.718389 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.718525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911f880-114d-4cf3-8604-ee14f918b7d5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.727668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.728390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.728715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.729026 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.751770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.752576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.752831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.753106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.761050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.762590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:09.777813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:09.778741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:09.779636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:09.780208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.795951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:09.797415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:09.860846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.879845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739cb3f-4414-4173-ae1c-192bfe33bb42 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:09.894987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:09.895798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:09.912992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:09.913798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.914110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.914391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.921059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:09.925154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ea9fa623-4f84-4a9b-a284-7857d54e6488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:09.933336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:09.935635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 251/503] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:09.937125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0b55-0865-4e3c-add4-a4062ad7e513 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:09.937847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0b55-0865-4e3c-add4-a4062ad7e513 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:09.937847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0b55-0865-4e3c-add4-a4062ad7e513 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:09.937847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 252/504] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:09.938890 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0b55-0865-4e3c-add4-a4062ad7e513 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.013088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ce3d-aee8-47f3-b450-d32ddf1de4ed None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.049066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.049858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.050169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.050445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.052091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0b55-0865-4e3c-add4-a4062ad7e513 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.060720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.062215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:10.079489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.080479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 253/505] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.081442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.089324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849035b-a047-4087-ad31-420e326a249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.089999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849035b-a047-4087-ad31-420e326a249e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.090311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849035b-a047-4087-ad31-420e326a249e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.090585 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849035b-a047-4087-ad31-420e326a249e None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.091428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849035b-a047-4087-ad31-420e326a249e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:10.091726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849035b-a047-4087-ad31-420e326a249e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.093188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849035b-a047-4087-ad31-420e326a249e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.102697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.111568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 253/506] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:10.112357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849035b-a047-4087-ad31-420e326a249e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.163212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.185955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc63a3-e432-4e70-9272-0512ca2f78d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.211415 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849035b-a047-4087-ad31-420e326a249e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.220470 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.221273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.221557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.221833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.231920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.233376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.244323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.244992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.245275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.245552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.246334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:10.246644 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.248035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6e64b6d4-dd60-4f83-b3e2-70c3c2b89079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:10.251212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.252069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.252926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:10.252926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:10.252926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.252926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:10.252926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 254/507] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.254015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.254015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.254206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.261084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 254/508] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:10.261084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.273229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:10.274566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:10.318665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.347624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:10.348492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.374887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228362ab-7c75-4609-adf6-0ee94422eb62 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.407575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.408384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.409049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.409325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.409599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.410356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:10.410667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.412170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.423772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 255/510] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:10.424485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.450444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead03e71-7e3b-4890-bd96-a2bc9d6acae6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.482915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.483570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.483854 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.484126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.526889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6fb5-6785-4c10-95b8-cbb514836f7e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.547582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.554112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.555589 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.562684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.563348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.563632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.563908 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.564666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:10.564981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.566389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.577474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 256/511] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:10.578283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.613382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.654648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 256/512] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:10.655370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.675793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d55e1-8f58-4f00-91a2-e8b0d5948f96 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.713021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.713820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.714105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.714402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.725725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.727234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:10.744271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.745164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.746192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:10.746192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:10.746192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.746192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:10.746192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 257/513] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.746919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.758289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72a81-c1ad-42c6-b0fe-b570936be5ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.778465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.794397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.795202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.795490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.795764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.806569 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.808373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:10.826343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.827339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.828841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:10.828841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:10.828841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:10.828841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:10.830363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 257/514] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.831266 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.845687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:10.853915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d0cc-7b84-440c-98c3-c9e8a7026477 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.888176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.888985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.889276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.889550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.897151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.898650 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:10.912931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.913847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:10.914803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 258/515] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.915354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:10.930523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1530-c6bd-4feb-a58d-8b9a51a1fb98 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:10.965514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:10.966342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:10.966630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:10.966910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:10.973639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:10.975131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:10.990958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:10.991979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:10.992822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 258/516] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:10.993301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.008294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.018314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6c01-d5ac-4aa6-9330-53b40e59ba3c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.051108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.052005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.052366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.052543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.061044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.063278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.064708 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:11.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:11.082381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:11.083309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:11.083309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:11.083309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:11.083309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:11.083309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 259/517] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:11.083565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.094225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8c31-a23c-424e-9739-4a1b66a133ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.128546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.129231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.129519 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.129875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.130642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.130956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.132356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.143926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 259/518] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.143926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.185738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b565057-0dbb-4292-89aa-8cb4f5ea2051 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.219630 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.220288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.220566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.220834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.221551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.221850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.223243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.234917 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 260/519] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.235679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.238841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.246186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778bd5-4b33-419a-9660-c5a32c0980a1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.275080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.280349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.281026 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.281315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.281591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.282486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.282798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.284279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.321365 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 260/520] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.322224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.338890 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281453-fbe6-483a-846c-c59eb6f70f4d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.373920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.374613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.374889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.375169 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.375956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.376268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.377731 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.395705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 261/521] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.400854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.419690 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48139-01ad-4d7d-92ac-f3a844086a0e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.453685 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.454390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.454674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.454976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.455717 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.456018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.457407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.461541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.468618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 261/522] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.469395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.498769 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd30e0-a36f-4619-a4b0-f1eee8c3d971 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.518952 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.533548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.534418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.534703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.534977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.542197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.543655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:11.558359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:11.559378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:11.560267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 262/523] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:11.560958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.574808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee0bb-42fb-4954-9e3f-4e1cb560bf8e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.610254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.610950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.611202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.611477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.612183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.613639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.633915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 262/524] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:11 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:11.634739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.664672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f69e6-b1dd-4bd5-8fa1-97b062bffc8b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.693207 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.705911 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.706414 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.706657 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.706931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.766471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17335095-ffa4-45aa-86ec-12fe0df76053 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.774195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:11.783076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.784589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.810220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:11.810987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:11.811338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:11.811626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:11.812491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:11.812808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:11.814324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:11.820318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 263/525] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:11.821520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.928474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 263/526] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:11.929972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:11.960473 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97896e-962d-45b2-9cb4-f5c1e5c83dc9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:11.968339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.011302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.012992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.013734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.014246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.024425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.026447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:12.046466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:12.047357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:12.048215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:12.050740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 264/527] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:12.052156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.056518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ccad0-b2b4-4aab-9d4d-ffa46e9f6178 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.090681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.115187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.116050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.116433 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.116804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.118342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:12.118761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.120852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.145814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 264/528] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 11 20:02:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:12.147256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.167316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df22223-6670-4678-b1b8-eb1e9d65192a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.203086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.203891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.204170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.204440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.215972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.218062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:12.241256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:12.242208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:12.243059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:12.243059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:12.243059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:12.243059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:12.243490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 265/529] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:12.244760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.250096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.270016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236e11e-d492-47c0-8bcf-c16ca201ad90 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.310434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.311469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.311749 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.312023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.312811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:12.313117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.314863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.328240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 265/530] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:12.329133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.352458 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.377104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0111ee-1021-4c58-a6b5-6111420a08a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.424921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.425587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.425865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.426175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.437949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8781-5d63-436c-b780-379ed5d80985 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.481087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.481978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.482716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.483084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.484061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:12.484371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.486327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.500301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 266/531] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:12.501201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.502333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.504320 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.504980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.606795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.618900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e321-001c-41dd-a37f-55c41f49d2d6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.627460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 266/532] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:12.628534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.662475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.663378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.664437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.664721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.665558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=d90591da6da54f888a3faf530b103888) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:12.665869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.667324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.674736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 267/533] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/role_assignments?user.id=d90591da6da54f888a3faf530b103888&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:12.675774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.798006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:12.823832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf87d7-46eb-4496-b5c2-d88fd9aea2d4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.863141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7b5b8-6337-44ed-bb8e-e2779fc0211a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:12.879723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.880561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.880845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.881121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.893555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.901434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:12.902278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:12.902562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:12.902837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:12.903990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.914011 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:12.922688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:12.923525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:12.924367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:12.924762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:12.924832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 267/534] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:12.931061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:12.944359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:12.945216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:12.946021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:12.946021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:12.946021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:12.946021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:12.946021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 268/535] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:12.951288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:13.055100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d505b-6359-4376-8509-fd896e216e32 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.062379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:13.086397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:13.093580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.094393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.094685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.094960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.095696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:13.096005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.097406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.114303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 269/536] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:13.119820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:13.224999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3c94-0025-482e-90fc-5bc0480f4bb6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.236121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8386-bb62-47e5-aa9d-91881ebb3aa5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.262067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.262067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.262067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.262397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.269619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.271327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:13.286536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:13.287392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:13.288201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:13.293517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:13.306670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.307637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.308423 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.308879 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.309861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:13.310379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.318056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.342068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:13.350014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 268/538] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:13.355397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:13.399029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffe489-8361-4633-a3bd-74548149e7b6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.439906 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.440583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.440866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.441145 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.441938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:13.442352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.443808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.465900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:13.479440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:13.575914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953dfc-cf28-440f-b5c9-46345a302728 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.577384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:13.651008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a71c-0458-4a5a-9d22-942a7db47d71 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:13.654365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:13.654759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.655447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.655735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.656016 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.656873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=3e257ac3d850495e8c06e4c9cb01e29c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:13.657192 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.658856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60fe9b-ef6f-4379-bf52-59e558649f95 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.674552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:13 2022] GET /identity/v3/role_assignments?user.id=3e257ac3d850495e8c06e4c9cb01e29c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:13.686985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:13.687669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.687952 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.688231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.689085 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=3d4f3e1239ec40daa85aec5e2825b161) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:13.689400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:13.690951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6c8f2-c1b3-45ab-8598-aaf348fa05d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:13.697859 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 272/541] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:13 2022] GET /identity/v3/role_assignments?user.id=3d4f3e1239ec40daa85aec5e2825b161&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:13.916318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d7c7-1e91-433f-a56f-1b9d2be74668 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.916993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d7c7-1e91-433f-a56f-1b9d2be74668 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.917460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d7c7-1e91-433f-a56f-1b9d2be74668 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.919311 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 270/542] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:13.924921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f7b4-a7fa-4c98-b908-2e3ea87e11bb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:13.925848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f7b4-a7fa-4c98-b908-2e3ea87e11bb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:13.926352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f7b4-a7fa-4c98-b908-2e3ea87e11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:13.945531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-aed5f7b4-a7fa-4c98-b908-2e3ea87e11bb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:13.947143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-aed5f7b4-a7fa-4c98-b908-2e3ea87e11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:14.029718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:14.064465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752d7c7-1e91-433f-a56f-1b9d2be74668 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.127852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570123d8-9d52-4328-b72e-d742ece64e50 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.128538 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570123d8-9d52-4328-b72e-d742ece64e50 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.129003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570123d8-9d52-4328-b72e-d742ece64e50 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.131037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 274/544] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:14.136573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.137091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.137575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.154918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:14.156400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:14.230469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 275/545] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:14.243669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752d7c7-1e91-433f-a56f-1b9d2be74668 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.255705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.282702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:14.329078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.329901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.330210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.330489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.356958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:14.369259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:14.370502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:14.371281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:14.376044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 271/546] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:14.382062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.388852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476d2d-acd6-4bea-b23f-28d964206745 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.411928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:14.481427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.483589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.484795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.485262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.493380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7f3f-e2c0-475f-8674-502f72764de0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.514668 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:14.522664 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:14.523547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:14.524316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:14.530622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 276/547] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:14.531808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.547705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.548731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.549225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.549695 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.550716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:14.551213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:14.552927 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:14.562730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 272/548] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:14.568989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.711528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:14.734395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:14.747471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf6fa-50f0-4c29-96bd-a1a9b8be0d85 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.758837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287b42c-2b79-4212-8658-4b9903c9651c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.794867 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.796025 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.796516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.796974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.808531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:14.810276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:14.831523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:14.832853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:14.833962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:14.833962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:14.833962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:14.833962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:14.836309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 273/549] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:14.843381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.845272 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.845967 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.846269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.846545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.847858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:14.848174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:14.849620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:14.872040 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 277/550] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:14.877586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:14.952310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8f7d1-2916-4946-84e1-b9707e65508c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:14.988096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:14.989322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:14.989798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:14.990294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:14.991235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:14.991733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:14.993327 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52092a34-9364-4ec1-9105-2ede90d3746b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.007291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.007847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 274/551] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:15.009572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7a10-921c-42f0-b6db-6da0e6229ae2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.010246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7a10-921c-42f0-b6db-6da0e6229ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.010681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7a10-921c-42f0-b6db-6da0e6229ae2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.012612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 275/552] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:15.019782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.020401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.020955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.038556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:15.040082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:15.068684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce11c0-0502-420f-aece-81e4587e317c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.112205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.113332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.113622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.114194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.126225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 276/553] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:15.127268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.134506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.135995 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.145706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:15.167276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:15.168330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:15.169194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:15.169194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:15.169194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:15.169194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:15.169572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 278/554] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:15.175386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.269814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de92bf-3c72-4993-a968-b5f2f7942789 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.298121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac853f-1553-4612-86ed-81f063baca11 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.307505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.316813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.317688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.317972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.318329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.329017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.330670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.332399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.333326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.333601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.333873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.344310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:15.347649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:15.349782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 277/555] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:15.352195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:15.353766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:15.359425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 279/556] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:15.361412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.421021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.468546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171fdad-2d7f-4ac6-ac86-ab0e14d6f103 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.482504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d669a76-b858-4fee-83cb-6c1d17d1fadf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.514705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.515432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.515670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.515952 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.516801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:15.517216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.518167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.518684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.519016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.519386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.519752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.520780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:15.521123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.522691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.532357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 278/558] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:15.533243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.535937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 280/558] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:15.536913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.590565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.642731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da599d4b-3609-4b8e-8dbb-5ec2e36bbecd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.677754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d511d-47db-4bb8-8cef-85c99067ff0b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.678768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.679568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.679942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.680313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.681228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:15.681601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.683469 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.700502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.703206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 279/559] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:15.704119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.723834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.724646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.724925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.725287 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.741540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.743044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:15.763891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:15.765956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:15.768194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:15.768194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:15.768194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:15.768194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:15.774135 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 281/560] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:15.774135 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.835193 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2c2f1-e647-4d6c-a109-c4bf4b991a99 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.848822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:15.879219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.880834 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.881571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.882079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.890802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644ec5-323e-484c-a988-183336621fd0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:15.891784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:15.893493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:15.912347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:15.913408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:15.915219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:15.915764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:15.916186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:15.939239 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:15.939904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:15.940189 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:15.940469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:15.998897 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.031037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.032410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a104-bcd9-400d-9a4e-962b27696142 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.048370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bfe6f-82d5-4651-98be-2200725b73e0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.082445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.083163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.083445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.083721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.084446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:16.084754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.086183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.097181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 281/562] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:16.098064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.125806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.130993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 282/563] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:16.132220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1ffb-d220-457e-aaeb-04341b11f5c8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.132508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1ffb-d220-457e-aaeb-04341b11f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.132781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1ffb-d220-457e-aaeb-04341b11f5c8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.134108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 283/564] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:16.135396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfaeef-d09e-4869-9dd7-0ed47fa1a73d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.135517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfaeef-d09e-4869-9dd7-0ed47fa1a73d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.135753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfaeef-d09e-4869-9dd7-0ed47fa1a73d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.136945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 284/565] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:16.137681 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfaeef-d09e-4869-9dd7-0ed47fa1a73d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.205890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce13086-b878-4dc7-bd91-bbeb38d8c491 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.209693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.238696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.239464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.239745 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.240000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.240885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:16.241202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.242692 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.242824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfaeef-d09e-4869-9dd7-0ed47fa1a73d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.260483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 282/566] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:16.261250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.278610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.279411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.279695 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.280016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.287323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.288731 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c016a128-17a8-4f89-ba1e-b38f9d4fa3e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:16.303159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:16.304115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:16.305029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 285/567] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:16.305707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54328-aa05-41ae-8442-b0bb8c5a1479 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.305953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54328-aa05-41ae-8442-b0bb8c5a1479 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.306243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54328-aa05-41ae-8442-b0bb8c5a1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.322804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9dd54328-aa05-41ae-8442-b0bb8c5a1479 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:16.323999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9dd54328-aa05-41ae-8442-b0bb8c5a1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:16.352883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.368615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9a7b-5879-46a4-9970-a1b1e5cc1a3c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.397134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 286/568] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:16.398440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.398723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.398992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.414984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:16.416155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:16.416993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.417830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.418373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.418967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.430244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.431715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:16.449287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:16.450241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:16.451131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:16.451131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:16.451131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:16.451131 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:16.454187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 283/569] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:16.455012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.470801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.482387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 287/570] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:16.483187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.552128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227b038-5285-4637-a90a-2101b89d7005 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.586382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.587181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.587463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.587722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.591861 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28e25b-8680-4149-bd93-c722a70fdaa7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.596061 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.598781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.601234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:16.618944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:16.619870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:16.620762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:16.620762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:16.620762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:16.620762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:16.620762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 284/571] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:16.621042 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.630545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.631238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.631520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.631799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.632642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:16.632956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.634431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.653696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 288/572] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:16.654575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.702706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.726147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f60-69a3-4388-97ad-68be047aa21c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.753780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eba-753a-40a1-921f-c138d7723811 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.760089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.760971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.761323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.761676 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.772886 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:16.780765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:16.781799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 285/573] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:16.782970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.789455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.790143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.790420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.790689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.791391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:16.791709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.793054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.804367 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 289/574] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:16.805077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.842859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.892200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6692-699a-47ac-b2c0-15416996f751 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.908974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1ae3-9a18-4bb0-a03f-b7b360f030ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:16.917865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:16.927357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.928163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.928450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.928728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.943429 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:16.943905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:16.944581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:16.944867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:16.945153 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:16.945894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:16.946232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:16.947616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:16.951299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:16.952347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:16.953290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:16.957527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 286/575] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:16.958357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:16.960027 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 290/576] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:16.960844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.059544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b934a0-bf3a-4758-a681-c1bfa12de3b4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.062405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7edc-352b-4375-b01c-ae9317bf8fb7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.072245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.092876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.093545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.093823 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.094121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.094879 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.095185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.096572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.096794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.097780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.097948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.098252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.104469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 291/577] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.105260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.109086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.110413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:17.127667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.128623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.129575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:17.129575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:17.129575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.129575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:17.129575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 287/578] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.129861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.139383 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.209120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb667-d7d4-4c1a-a079-1e0557740754 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.226586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35141e33-a4fc-4575-9147-5050e36eb1d1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.243868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.244754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.245128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.245542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.252306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.253784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.259083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.259751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.260064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.260330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.261083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.261390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.262787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:17.268213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.269080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 292/579] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.270543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.271279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 288/580] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.271607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.303224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.365549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.375443 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f96f6-7e08-46c7-a4fc-7bed1da80a6b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.388833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01abc8b-29bd-47c2-9743-b22b8a1aa056 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.409365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.410292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.410573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.410919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.417527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.419011 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.422827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.423628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.423907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.424183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:17.432958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.433843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.434886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:17.435386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.435648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 293/581] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.436469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.436910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:17.454210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.455238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.456290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:17.456290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:17.456290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.456290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:17.456290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 289/582] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.456601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.532653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.540614 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b24cd-ebf3-4455-bc6c-ef111c07ccac None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.556260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d227-9811-4ed6-afb2-e2ccee6922d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.574060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.574732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.575015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.575291 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.576015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.576323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.577703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.588302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.588963 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.589387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.589485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 294/583] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.589600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.590067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.590498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.590818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.592354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.601876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.605277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 290/584] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.606183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.690900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8a5b-3620-4074-b56d-84de0ae3ad99 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.712696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eaa3f-e577-45d8-acd7-648ed86b0aac None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.727767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.728560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.728839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.729112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.739830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.741290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.749809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.750497 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.750769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.751043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.751826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.752137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.753561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.756049 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:17.758755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.759761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 295/585] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.765583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.766008 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 291/586] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.766177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.822862 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:17.863201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b28e-3d13-455d-a71b-1cc99c40e4a2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.867820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605504-2c5c-4ed6-b46a-0be8a306cf66 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:17.897398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.898096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.898377 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.898646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.899368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:17.899669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.900356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:17.901082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.901184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:17.901435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:17.901716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:17.911934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:17.913494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 296/587] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:17.913494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.913681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:17.929288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:17.930306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:17.931256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 292/588] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:17.931774 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:17.994814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.030797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf4458-d373-4592-80b8-d86a43b56661 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.042148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc405571-ed75-44c0-acc1-4855a9bd71ff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.055887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.067848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.068510 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.068785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.069054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.069883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=7368871bcd14466cb7513218ad0f003c) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:18.070224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.071658 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.075898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.076563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.076844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.077251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.077366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 297/589] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/role_assignments?user.id=7368871bcd14466cb7513218ad0f003c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:18.077868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.077959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:18.078314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.079674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.092543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 293/590] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:18.093763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.195396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b392f-c596-4731-9fd5-f0e3a8ac5c3c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.206573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fac0-7596-4043-bf94-6e4de817e68b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.224563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.237458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.238392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.238674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.239057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.249811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.250595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.250885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.251163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.254961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=a71d566879c44440bc4675b59c6d54e1, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.256485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.259175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.260621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.278744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 298/591] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:18 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:18.278744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:18.279054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:18.280109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 294/592] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:18.281045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.346998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.428853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26a2c-f897-408b-9fd0-141d408dbcd6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.450707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc9d4-2b66-4825-b0c0-28e116d79c74 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.470445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.471506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.471951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.472370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.480675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.482337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.496054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.496737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.497019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.497298 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:18.497957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:18.498889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:18.499874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:18.500411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:18.500411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.500411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.502603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:18.504044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.514616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 299/594] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:18.515996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.552790 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.619348 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982879-4757-47da-822f-b1cbd7a54822 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.630388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.635870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a57a-18dd-4f97-9105-06dc00160b2e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.654147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.654842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.655268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.655384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.656259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:18.656578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.658187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.673263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.674317 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.674743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.675165 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.676151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:18.676653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.678294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.682283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 296/595] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:18.683480 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.698000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 300/596] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:18.699159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.786634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822bd4-2d81-4ac9-ab49-4ec6b4e3efd1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.795954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:18.809247 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26960b-3d8d-4a39-9eb5-16e582087aef None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:18.843066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.844232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.844657 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.845085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/d90591da6da54f888a3faf530b103888/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.852328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:18.853152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:18.853436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:18.853713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:18.863015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=d90591da6da54f888a3faf530b103888, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.864678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.866640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:18.869100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:18.879754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 297/597] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:18 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/d90591da6da54f888a3faf530b103888/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:18.880915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:18.906092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:18.907067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:18.908654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:18.908654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:18.908654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:18.908654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:18.913602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 301/598] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:18.918459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:18.934255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.090301 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86cab0-a170-42d3-b4be-134f510d6d9b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.109929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcfef1-c824-48ef-815b-47bcbb01410e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.126568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.127684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.128172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.128650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.139415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.141136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.143991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.148557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.149306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.149589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.149865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.151854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:19.152173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.153750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:19.163842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:19.164751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:19.165636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:19.165636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:19.165636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:19.165636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:19.167923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 298/600] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:19.168031 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 302/600] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:19.174069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.175187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.243748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.281647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1b5e2-b628-429a-8f0a-a972ba9a95e0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.317782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.318881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.319372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.319860 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.320790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:19.321296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.322904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.335273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 303/601] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:19.347086 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.383915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25293-b5b0-41d8-9a4f-8777715b8088 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.470819 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.471650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.471927 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.472123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021e7f-30c4-4b73-a202-0bb0003388bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.472229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.487446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.489012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.500601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.509522 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.510368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.510653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.510927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.518275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.519739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:19.522539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:19.523406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:19.524280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 299/602] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:19.530659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:19.535144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:19.537236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:19.539384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:19.543215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 304/603] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:19.543215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.661951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.681292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68762f5d-4b15-403c-bcb5-1d14f86bba69 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.736267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15123f-bc52-44ee-bfb9-b44e8a5c13ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:19.742719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.743435 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.743716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.743989 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.744781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:19.745092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.746578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.774110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 305/604] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:19.778182 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.807247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:19.808239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:19.808514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:19.808785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:19.809580 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:19.809888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:19.815681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:19.836158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 300/605] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:19.840286 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:19.862435 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:19.952045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a15b-887d-496f-83a6-afb447974f89 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:20.007954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fe903-159c-48bd-aa21-49c29e8b1019 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:20.012134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:20.013038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.013311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.013580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/3d4f3e1239ec40daa85aec5e2825b161/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.039088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:20.039484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=3d4f3e1239ec40daa85aec5e2825b161, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:20.040950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdf6c8-4332-42c3-93ca-df4011a8e252 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:20.066059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 306/606] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:19 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/3d4f3e1239ec40daa85aec5e2825b161/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:02:20.074367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:20.075285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.075569 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.075862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/3e257ac3d850495e8c06e4c9cb01e29c/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.092516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=3e257ac3d850495e8c06e4c9cb01e29c, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:20.093981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32699b02-ab07-42d2-a314-66afc1d6a6ed None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:20.116730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 301/607] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:19 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/3e257ac3d850495e8c06e4c9cb01e29c/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:02:20.291618 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892dc83-d553-4251-8657-f7b83e4586c1 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.292141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892dc83-d553-4251-8657-f7b83e4586c1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.292141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892dc83-d553-4251-8657-f7b83e4586c1 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.293735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 307/608] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:20.299811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aa18-9b91-48bf-bcb3-be335932aad2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.300539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aa18-9b91-48bf-bcb3-be335932aad2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.301018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aa18-9b91-48bf-bcb3-be335932aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.319883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5102aa18-9b91-48bf-bcb3-be335932aad2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:20.321427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5102aa18-9b91-48bf-bcb3-be335932aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:20.409837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 302/609] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:20.452121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892dc83-d553-4251-8657-f7b83e4586c1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:20.576504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:20.587692 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892dc83-d553-4251-8657-f7b83e4586c1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:20.625054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee69dd-b6d5-49cc-acfc-ec2603ebe0e1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.625383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee69dd-b6d5-49cc-acfc-ec2603ebe0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.625631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee69dd-b6d5-49cc-acfc-ec2603ebe0e1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.627540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 303/610] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:20.632845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.633362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.633846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.650980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:20.651273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:20.652053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.652336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.652608 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.653321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:20.679227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:20.687656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:20.688587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:20.689425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:20.700359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 308/611] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:20.706313 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:20.765233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 304/612] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:20.800572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:20.856392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:20.865082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f302-2c70-42a7-9cb7-49b93a162297 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:20.935848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1259c6-e61d-4617-904c-e8956c777c10 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:20.969713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:20.970429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.970710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.970982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.971741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:20.972046 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:20.973494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:20.978168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:20.978983 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:20.979265 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:20.979542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:20.994133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 309/613] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:20.998283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:21.007032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:21.010920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:21.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:21.012714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:21.017094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 305/614] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:21.027028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.031057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.163509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.180604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe12bce-7624-4148-a815-ebd71831fe5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.204736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd37c6-b09e-438f-bcb4-fb071eb4810d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.222734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.223802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.224289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.224831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.225804 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:21.226499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.228096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.251277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 306/615] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:21.254449 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.276285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.277811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.278409 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.278885 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.291539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.293446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:21.314798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:21.315724 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:21.316635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:21.316635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:21.316635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:21.316635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:21.319803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:21.330077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.438535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.439727 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3af135-93e1-4ed5-a055-1f301fe9373d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.476221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.477034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.477318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.477596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.478404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad4342-5cb4-452b-951c-491441698e75 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.488586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.490148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.506806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-393267e3-79ad-40ce-8f3e-c50c068450c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:21.509366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:21.510358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:21.511670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:21.511670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:21.511670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:21.511670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:21.511670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 307/617] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:21.514101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51b74-4439-4557-a9f4-4292e3b77e9b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.514101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51b74-4439-4557-a9f4-4292e3b77e9b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.514101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51b74-4439-4557-a9f4-4292e3b77e9b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.514359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.514855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.516408 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.516540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 308/618] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:21.519333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.519491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51b74-4439-4557-a9f4-4292e3b77e9b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.520241 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:21.520564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.522001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf05ec-cc2f-44b8-bb02-fc917130e2c0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.536721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 311/619] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:21.538139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.538646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.538928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.556816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:21.558365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:21.633760 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 312/620] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:21.635560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.668866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51b74-4439-4557-a9f4-4292e3b77e9b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.711683 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.712556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.712847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.713126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.714136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:21.714872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.716762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.717751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.734884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:21.736200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.767171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad018d1c-278d-44c1-a34c-d48f5e8357e5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.797268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.803651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.804787 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.805298 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.805935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.817817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:21.819593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:21.838831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:21.839799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:21.840739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:21.842224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698febe-00a8-42cf-a734-33514552b337 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.843631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:21.844738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.877969 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.878813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.879097 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.879398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:21.890170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:21.898079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:21.899043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:21.900312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:21.954295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e097-77c2-43c6-a0ab-30d66df82777 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:21.975901 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:21.992743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:21.993963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:21.994464 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:21.994933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.002974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.004784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.010653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f464f7-06a7-407c-b25b-a4887c258a55 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:22.020502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:22.021452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:22.022451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:22.025104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 314/624] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:22.026218 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.031861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.047535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.048232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.048516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.048820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.049682 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:22.050055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.051601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.070179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:22.071040 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.137640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be3cc-6938-44f3-a683-cadbe91c6704 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.174077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.174617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d187b-aac2-42d9-92cc-89defc4397bb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.175358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.175835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.176674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.177690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:22.178294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.179897 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.189572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:22.190847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.215165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.215873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.216143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.216421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.217276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:22.217591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.219181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.237275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 312/627] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:22.238406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.242569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.273768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.304311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78cd4-a9d3-4446-a0df-9fac2417dbd0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.340752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.341964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.342469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.343013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.343117 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae90a1-3cca-4e73-b110-01ad8c1d5789 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.354713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.356469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:22.374254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:22.375265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:22.376166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:22.376166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:22.376166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.376166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:22.378536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:22.378641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.379514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.379805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.380085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.380509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.391052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.392591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:22.411059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:22.412124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:22.413213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:22.413213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:22.413213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.413213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:22.416818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 313/629] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:22.417655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.477448 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.484558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771fede-89c4-4e92-a921-70a1f95685ee None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.503887 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.516237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f005-fece-470d-9a8c-e36b9b141385 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.518906 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.519632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.519914 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.520234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.551686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.552577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.552856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.553133 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.553865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:22.554209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.555596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928ac0-e9bd-44e2-923c-1ba3024bf658 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.567263 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 314/630] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:22.568565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95323-ca34-44a9-b8e8-d0a367736a65 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.568856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95323-ca34-44a9-b8e8-d0a367736a65 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.569132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95323-ca34-44a9-b8e8-d0a367736a65 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.572124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 315/631] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:22.572124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b95323-ca34-44a9-b8e8-d0a367736a65 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.590482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.592019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e73f5-afa4-462f-a1db-5759f246fae2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.675105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b95323-ca34-44a9-b8e8-d0a367736a65 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.685467 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.694450 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 317/632] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:22.696121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bae-b84f-4781-b626-270838312c0e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.696506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bae-b84f-4781-b626-270838312c0e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.696995 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bae-b84f-4781-b626-270838312c0e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.698818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 318/633] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:22.699633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3bae-b84f-4781-b626-270838312c0e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.716476 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.717142 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.717416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.717690 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.718461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:22.718770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.720244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f373a-3320-4d4f-930f-9f7f9036bf98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.733370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 316/634] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:22.734620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.734909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.735185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.750799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:22.751994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:22.754010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.804834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3bae-b84f-4781-b626-270838312c0e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.827169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 317/635] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:22.827169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.847627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.848455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.848740 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.849015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.855874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.857319 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9fae0f06-afcb-48fe-b007-29d457cc909f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:22.870898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:22.871929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:22.872825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 319/636] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:22.873317 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.873495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.873759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.889698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:22.890927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:22.928965 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947243e8-23be-46c6-a2ed-f8371cf8c9bf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:22.939883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.957852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 320/637] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:22.958700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:22.962060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:22.962881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:22.963166 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:22.963445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:22.970769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:22.975255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:22.976769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:22.994290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:22.995264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 318/638] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:22.996361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.061945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cecb6-a4a0-45d3-9fbf-b2d164aaad0a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.095475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.096067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4024f-9e2d-4578-8709-4cf4a54a73ad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.096269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.096547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.096812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.105571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.107373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:23.124736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:23.125767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:23.126841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:23.127516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 321/639] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:23.128276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.135652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.136472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.136755 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.137036 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.149936 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:23.157775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:23.158831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:23.159699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 319/640] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:23.160411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.178555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.213126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.232118 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427dccd-911a-4af1-bd56-1fdfd762be92 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.264279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819b57-8781-464b-95f6-65feb71f8eca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.267437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.268103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.268385 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.268665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.269454 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:23.269765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.271340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.283056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 322/641] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:23.283918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.298940 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.299751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.300030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.300305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.310591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:23.318468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:23.319376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:23.320305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 320/642] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:23.321010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.383404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e5f6-3339-4d78-adb5-e9d56afca8c3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.385681 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.418446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.419108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.419411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.419683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.420402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:23.420711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.420815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f7069-2162-4d7f-91dc-75ef1480b6f1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.422070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.431424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.434166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 323/643] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:23.434987 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.459546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.460234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.460521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.460789 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.461645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:23.461960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.463447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.480645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 321/644] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:23.481419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.537671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645bc5b-f1d8-4748-b3d2-b25d33bb57a0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.572012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.572887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.573173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.573443 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.574235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:23.574543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.575913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.580719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134a78-dba6-4f74-bc75-b7352912a018 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.583864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 324/645] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:23.584655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.612785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.614813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.615719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.616006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.616282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/7368871bcd14466cb7513218ad0f003c/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.630410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=7368871bcd14466cb7513218ad0f003c, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.631862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.646196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 322/646] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:23 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/7368871bcd14466cb7513218ad0f003c/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:23.646958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.668455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.690982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c74d5-51cd-44ed-a66e-afac9cac0d86 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.729147 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.729846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.730158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.730444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.731224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:23.731534 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.732961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.742547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 325/647] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:23.743422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.769506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4df970-a075-488d-88c7-92a54302c818 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.813255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.814127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.814411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.814685 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.825237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:23.825237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:23.841734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:23.842764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:23.843809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 323/648] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:23.844410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:23.852791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.866007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca2f3-46e9-4f78-9660-797a84c7a2f1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:23.911710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:23.912634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:23.912920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:23.913198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:23.951628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:23.982943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3f1b-24c8-4e9a-b2a3-3644f9124406 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.001669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.003591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.017477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.018320 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.018607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.018888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.029868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.031354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:24.049516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:24.050526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:24.051474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:24.051474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:24.051474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.051474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:24.051474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 324/649] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:24.052784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.124464 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.143182 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 326/650] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:24.144495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.163826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662249f8-42dc-4465-a8f5-4b3e2eb69bbe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.198850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.211798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.212610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.212890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.213157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.227662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.229115 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:24.249486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:24.250571 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:24.251457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:24.251457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:24.251457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.251457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:24.258002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 325/651] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:24.259152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.264537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c74cc-0471-48d3-b6cf-cc659e09cf31 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.301957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.302743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.303088 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.304024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.305591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.305962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.310430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.322839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 327/652] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:24.323792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.372252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.381541 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a82-dff2-4586-8f03-e570fc859228 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.426803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2acb5c-8e5d-4459-b48f-714ea4125e24 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.429905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.430632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.430914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.431184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.431916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.432222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.433932 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.447156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 326/653] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:24.448448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.462042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.462863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.463146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.463422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.474560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.476001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.491828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:24.495544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:24.496506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:24.497469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:24.497469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:24.497469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:24.497469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:24.497469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 328/654] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:24.497770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.554922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cba28-2643-4b96-a76a-85c2cc34444c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.591892 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.592617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.592830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.593100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.593817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.594150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.595635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.598899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.601821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4e72-1083-4747-a80f-5dea95d81655 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.608747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 327/655] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:24.613188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.642716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.643304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.643585 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.643856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.644687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.645025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.646528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.662370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 329/656] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:24.662370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.746978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d2fd-05dc-404e-9d5c-63b7a9d7908f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.749234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.775306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979cac-6e85-4035-8cf9-f1cb53c4fd44 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.788935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.789943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.790391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.790744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.800007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.801741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.812816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.813711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.814076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.814428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.815243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.815616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.817213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:24.821869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:24.823043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:02:24.824188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:24.830284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 328/657] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:24.831403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.831610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 330/658] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:24.832842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:24.858960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:24.947499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe20a-cbe0-40d3-a941-1cce0ca4c2e1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.966201 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b168bf0-5535-4194-8a9b-e1fd3e1d333e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:24.985232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:24.986014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:24.986322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:24.986595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:24.987547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:24.987855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:24.989382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.006779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.007674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.007891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.008001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 331/659] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:25.008803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.010393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.023879 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.026014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:25.045758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:25.046754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:02:25.047719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:25.048579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 329/660] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:25.052021 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.076229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.104210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.122945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc134ea-7cbd-4522-8d3b-23b5d87652d1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.159461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.160358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.160779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.161121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.168234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.169680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.170622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9ff7-181f-4d3f-b6a2-16a75eca8d05 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:25.184133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:25.185284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:25.186201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 332/661] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:25.186717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.216968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.218238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.218655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.219031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.308132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.310477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.318499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f25c86-f0dc-4ec6-b8e1-945a4da5a063 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.338525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.358612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.359593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.359593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.359908 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.360658 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:25.360966 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.362598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.376748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.381904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 333/662] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:25.382821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.429962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 330/663] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:25.431152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.483772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181769-90cb-40de-9354-97c2bce1e7de None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.518688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.519336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.519785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.520155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.521019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:25.521398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.522956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.538850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 334/664] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:25.541615 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.549256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c243e7-4a95-4300-8501-5e4cace1d697 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.576716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.590671 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.591632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.592188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.593169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.602566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.643877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825048a5-8b70-48e8-b8fa-bb5e945cfc0d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.669621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.671436 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6f70-20c6-453a-9f24-e2a606dc80bb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.677653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.678583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.678933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.679280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.690439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.692023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:25.709242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:25.710163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:25.711068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:25.711068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:25.711068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:25.711068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:25.711068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 335/665] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:25.712225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.777948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 331/666] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:25.779267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97febb7-5aa0-40e2-a205-3e5b13ac778a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.779563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97febb7-5aa0-40e2-a205-3e5b13ac778a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.779848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97febb7-5aa0-40e2-a205-3e5b13ac778a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.785241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 332/667] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:25.786128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97febb7-5aa0-40e2-a205-3e5b13ac778a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.813347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.833555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297cfee-86c7-4468-a595-1afd6479975c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.847646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:25.870904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.871568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.871849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.872125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.872953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=d90591da6da54f888a3faf530b103888) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:25.873267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.874861 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:25.881297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 336/668] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/role_assignments?user.id=d90591da6da54f888a3faf530b103888&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:25.890347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:25.919058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97febb7-5aa0-40e2-a205-3e5b13ac778a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:25.972279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:25.973182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:25.973565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:25.974655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:25.975544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:25.975964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:25.978349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089aa3-45de-4e22-8d9d-288129b3b6a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.001033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 333/669] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.001033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.001033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.001033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.009501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854b70b-6efa-496d-b80a-a061bd9ffdda None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.024279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:26.026824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:26.051896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.052821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.052949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.053167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.069755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.071531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:26.091151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:26.092104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:26.093429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:26.093429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:26.093429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:26.093429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:26.093429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 337/670] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:26.093707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.115460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 334/671] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:26.115460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.131303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.139362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.223848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaa1e7-ee6b-414e-b8a6-c8e903383db1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.229439 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09d8d1-d240-40c0-a086-28d752c13c9f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.260174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.261547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.262072 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.262540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.266313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.266991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.267276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.267557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.268293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:26.268608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.270041 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.271235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.273081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.287083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 335/672] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.287977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:26.289105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:26.290071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:26.291125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:26.297818 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 338/673] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:26.299075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.366599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.393921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.400317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aceeb-c4ec-4dcc-b317-b2709cab3286 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.406405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3270-b421-4e69-92ef-e2a52b51423e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.437512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.438802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.439416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.439984 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.442747 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.443547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.443825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.444094 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.451213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.452735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.454001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:26.462390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:26.463342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:26.464205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:26.471354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:26.472257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 339/674] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:26.473201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.474699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 336/675] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:26.475750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.579872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d4f2d-8dfd-43be-b1e9-4f9f585f7356 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.618132 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.618719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.618998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.619269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.619548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95858-dfc6-4f65-819b-3645d8fd6fd4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.620053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:26.620363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.622150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.642130 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 340/676] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.643311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.659211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.662158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.667069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.668139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.668978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.669438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.670676 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:26.671326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.673175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.689210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 337/677] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.689210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.778325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e15b-34a2-4b04-901b-6e62428809ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.805627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083af7-99cf-41cf-9bc5-63706c3b1721 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.817880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.818945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.819445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.819931 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.820927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:26.821446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.823110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.844439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 341/678] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.844439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.846083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:26.846744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:26.847152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:26.847448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:26.848362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=3e257ac3d850495e8c06e4c9cb01e29c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:26.848675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:26.850153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:26.862200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 338/679] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/role_assignments?user.id=3e257ac3d850495e8c06e4c9cb01e29c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:26.863156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:26.933915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.942535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:26.963172 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d53b-7011-4036-8a71-42dcca48a311 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:26.980770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425742-c079-4cf5-8f4f-5619a4f349df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.000429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.001719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.002281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.002765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.015051 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.017215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.017353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.018149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.018495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.018832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.019741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=3d4f3e1239ec40daa85aec5e2825b161) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:27.020333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.021681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849445-12ae-4220-8e55-4ea1c6a1acfb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.028381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 339/680] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/role_assignments?user.id=3d4f3e1239ec40daa85aec5e2825b161&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:27.037314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196245-4995-4cc3-becc-9c47ebdef55f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.037314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196245-4995-4cc3-becc-9c47ebdef55f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.037314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b196245-4995-4cc3-becc-9c47ebdef55f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.037314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 340/681] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:27.038396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.038687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.039013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:27.049143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:27.050295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:27.051452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:27.051452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:27.051452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:27.051452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:27.053425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 342/682] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:27.058135 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:27.059211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.059331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:27.146186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 341/683] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:27.163798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.180631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdc553-0324-41b3-8ef4-1b1239860cc8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.204835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:27.220983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.221668 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.221953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.222269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.223041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:27.223384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.224792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.226388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:27.238522 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 343/684] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:27.244002 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.287283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c69d5-8b83-4662-946e-b724bec55c08 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.335229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.336056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.336338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.336614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.348866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:27.361377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:27.362367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:27.363212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:27.363915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 342/685] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:27.370758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.401396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869dfa-e7d3-4f3e-a38a-9a858dde8fc4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.467333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.468157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.468439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.468718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.483115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.484563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.507706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa28dd-9706-4abb-8d14-9380d26e5cba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:27.518054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:27.519004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:27.520090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:27.522177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 344/686] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:27.526129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:27.535060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.573294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.574022 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.574321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.574639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.575401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:27.575706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.577089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.593572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 343/687] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:27.600437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.604623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:27.712675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7064-7550-496a-a75c-224bb1e99792 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.746983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.747783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.748068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.748339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.749182 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:27.749489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.750955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.773592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 345/688] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:27.774968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:27.789462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67edce-14ed-436f-b56d-8bb3678530d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.875151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d00d2-afd7-411b-bee6-c3e1b145e7b7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:27.889417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.890599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.891088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.891620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.906475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:27.911223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:27.911556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:27.912259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:27.912535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:27.912805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:27.916693 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:27.951915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:27.953058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:27.954198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:27.954198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:27.954198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:27.954198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:27.954198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 344/689] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:27.959399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.012241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.088822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27c7ef-0fc5-48cd-81f0-cff5968c795e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.089864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.091393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad230a35-9d0c-4f06-8090-d89ecb281061 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.136367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.137580 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.137862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.138164 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.138902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:28.139436 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.141264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.171520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 345/690] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:28.176910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.249496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.255409 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 346/691] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:02:28.257117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542f5f-567a-441a-bbd7-ef866d795a97 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.257500 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542f5f-567a-441a-bbd7-ef866d795a97 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.257870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542f5f-567a-441a-bbd7-ef866d795a97 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.263742 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 347/692] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:28.264981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542f5f-567a-441a-bbd7-ef866d795a97 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.294484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.313059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe79c5f-fd6d-492d-9e11-de0abb1f84bd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.358510 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.359859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.360315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.361226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.371092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.373254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.384770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542f5f-567a-441a-bbd7-ef866d795a97 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a62426e2-5a5e-4588-a327-f7bf4cf5fd14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:28.391116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:28.392028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:28.393185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 346/693] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:28.394187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.394574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.394945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.416210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:28.417437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:28.425491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.426640 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.427159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.427669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.439738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.441646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:28.462544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:28.463516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:28.464410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:28.464410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:28.464410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:28.464410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:28.466575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 348/694] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:28.467652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.500039 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 347/695] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:28.501831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.527842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.581274 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60e8f-82ef-4db6-ba96-5d91f24b6ff7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.603108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.618884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.619732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.620106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.620474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.621511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:28.621922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.623558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.632534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43587e-fdff-4a98-8860-7b39fc8210b2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.642841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 349/696] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:28.643895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.674450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.675009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.675384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.675752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.676634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:28.677039 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.678554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.695270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 348/697] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:28.696269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.775546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417aab-bfa1-4515-a60c-b995b0768ff3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.788243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.806123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255ea2-ce5c-404b-8b62-965aa6450aa7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:28.825693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.826798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.827079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.827352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.828412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.829794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.846816 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:28.847805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:28.848109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:28.849035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:28.849895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 350/698] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:28.850806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:28.851332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:28.851793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:28.856771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:28.928296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:28.930086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:28.967655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27fa5-5cd7-4228-ad0a-3a290d0978eb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.003949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.004916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.005264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.005602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.013170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.014851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:29.030325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:29.031228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:29.032103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:29.036463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 351/699] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:29.037447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.038228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 349/700] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:29.039459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.071652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.075214 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.145028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baaceb-a324-48de-b89e-f3531195747e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.146227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3bc0-a07b-480d-b329-9eeb0d2f5459 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.185864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.186810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.187214 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.187588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.187885 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.188632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:29.188876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.189157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.189436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.189850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.190727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:29.190977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.191310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.193113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.198368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 352/701] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:29.199487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.209236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 350/702] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:29.209236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.306666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.309150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.314197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1b4b-4ee7-4525-8197-e340afa4f56f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.316596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203a331-cb70-4315-bfba-ac210c840edc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.350025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.350851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.351133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.351398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.351945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.352630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.352916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.353190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.353900 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:29.354483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.355614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.361503 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 351/703] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:29.362322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.372074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.373576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8c3de8fa-e92d-4e5b-a430-d6ffa58798b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:29.395923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:29.396868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:29.397754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:29.397754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:29.397754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:29.397754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:29.399735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 353/704] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:29.401012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014b6d-4198-445c-bd5c-f4f413e43fed None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.401293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014b6d-4198-445c-bd5c-f4f413e43fed None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.401568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014b6d-4198-445c-bd5c-f4f413e43fed None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.403076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 354/705] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:29.404067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfafe0-18e4-4f98-8a4a-10a6ccae7210 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.404319 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfafe0-18e4-4f98-8a4a-10a6ccae7210 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.404591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfafe0-18e4-4f98-8a4a-10a6ccae7210 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.405805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 355/706] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:29.412511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfafe0-18e4-4f98-8a4a-10a6ccae7210 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.491282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30b40b-ebaa-4d74-8a2f-51ba68522628 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.530435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.531506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.531825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.532066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.532914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=7368871bcd14466cb7513218ad0f003c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:29.533283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.533396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfafe0-18e4-4f98-8a4a-10a6ccae7210 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.536150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a65c1-dced-4c81-8c21-9418a5153097 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.542614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 352/707] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/role_assignments?user.id=7368871bcd14466cb7513218ad0f003c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:29.543921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.544273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.544669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.563670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:29.564836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:29.583188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.584425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.584861 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.585283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.586392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:29.586737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.587008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.589010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167562e-6e8e-48dc-8edc-8a6c458d03a1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.605900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 356/708] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:29.607446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.607839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.608213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.626441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:29.627951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:29.630460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.658584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 353/709] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:29.659729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.738685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 357/710] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:29.739710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.789209 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd07a3-35de-4ca5-8ac4-010cc414904d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.828802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.829622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.829910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.830218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.837903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.839384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:29.855701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:29.856634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 354/711] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:29.858258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.879858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2208-f03b-4ea7-b276-d7c13064ea8a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:29.882220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.923142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:29.923992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:29.924272 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:29.924542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:29.932430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:29.938876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:29.940405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:29.959029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:29.959965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:29.960892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:29.960892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:29.960892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:29.960892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:29.960892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 358/712] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:29.961387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:29.981130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d8ae-fdbf-4df8-bbb2-282a2f711a8a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.017946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.019027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.020091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.020513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.021598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.023807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:30.040488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:30.041744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:30.042687 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:30.046292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 355/713] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:30.047267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:30.086182 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fc7b-ee9a-40a2-bbd9-a246daa431a7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.124198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.124942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.125215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.125515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.126388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:30.126787 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.128360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.143907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:30.146263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:30.147527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:30.170870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dd487-54ec-4fdf-957f-36ec97ede9e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.203301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:30.208250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.209503 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.210353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.210772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.211639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:30.212205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.213885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.228189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 356/715] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:30.229313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:30.259030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe430f-1b50-48ed-9fdb-be41b966fc32 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.292900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.293565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.293849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.294161 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.294865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] RBAC: Adding query filter params (name=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:30.295174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.296520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.305891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 360/716] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:30.306770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:30.336913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2e7f-bede-48e8-b5eb-b5d97c9f8851 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.373632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.374631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.375137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.375543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.376648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:30.377101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.378696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.386404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 357/717] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:30 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:30.387424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:30.390388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:30.424776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0561-06ec-4530-bc50-690c837d494f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.456106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:30.492103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.492790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.493062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.493338 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.494068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.495523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167446ee-dc7f-496d-be83-6e90720ba74c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.505181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fff45c-3d0d-4e1d-8491-26258a13841a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:30.542833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 361/718] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:02:30 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:30.549453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:30.550528 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:30.550960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:30.551656 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:30.552629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:30.553110 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:30.554724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deccf3-1443-4e2b-bc97-66b0024dbb9b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:30.561391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 358/719] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:31.501743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2bd7f-0f8d-4122-8c27-05c0f77ef1fe None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:31.502331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2bd7f-0f8d-4122-8c27-05c0f77ef1fe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:31.502331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2bd7f-0f8d-4122-8c27-05c0f77ef1fe None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:31.504028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 362/720] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:31.519701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b15-d893-47ec-b80e-6c8099c9aac3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:31.520609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b15-d893-47ec-b80e-6c8099c9aac3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:31.521057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b15-d893-47ec-b80e-6c8099c9aac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:31.545645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ccc01b15-d893-47ec-b80e-6c8099c9aac3 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:31.547152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ccc01b15-d893-47ec-b80e-6c8099c9aac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:31.622897 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:31.636740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 359/721] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:31.664650 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2bd7f-0f8d-4122-8c27-05c0f77ef1fe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:31.813392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2bd7f-0f8d-4122-8c27-05c0f77ef1fe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:31.863728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:31.864402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:31.864680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:31.864949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:31.865723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:31.867168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e47e-079e-4e8f-afa4-aaf25ed45f39 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:31.892873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 363/722] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:02:31 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:32.041442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571961a1-d8a4-48d6-8c79-3d0c1f3129ca None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.041759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571961a1-d8a4-48d6-8c79-3d0c1f3129ca None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.042001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571961a1-d8a4-48d6-8c79-3d0c1f3129ca None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.043712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 360/723] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:32.049779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.050131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.050414 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.071201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:32.072704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:32.100416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:32.155820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 364/724] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:32.185623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571961a1-d8a4-48d6-8c79-3d0c1f3129ca None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:32.304137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571961a1-d8a4-48d6-8c79-3d0c1f3129ca None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:32.350888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:32.352004 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.352481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.352934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.367213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:32.375420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:32.376444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:32.377300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:32.379774 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:32.385426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:32.508586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280a25-f17c-40d7-8e3a-1ddfac85272b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:32.551822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:32.552759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.553192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.553638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.554568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:32.555024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:32.556689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:32.570290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 365/726] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:32.575857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:32.635001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:32.680644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6dd9-0527-4fba-858a-f88536ed0197 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:32.728940 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:32.729751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.730041 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.730318 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.746080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:32.747850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a2d265bb-c3bc-47fd-9770-3dcc07ea29fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:32.768425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:32.769402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:32.770401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:32.770401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:32.770401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:32.770401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:32.770401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 362/727] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:32.775702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:32.795777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:32.899508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bddcb6-78ca-4c73-91e9-bc4f882ef487 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:32.934467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da8e7-f8cc-4b4f-aa9f-bd1aeeebc9d6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.935031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da8e7-f8cc-4b4f-aa9f-bd1aeeebc9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.935475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da8e7-f8cc-4b4f-aa9f-bd1aeeebc9d6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.937063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 363/728] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:02:32.945261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10bd0-5a43-48a5-a409-f2d23a1aaf92 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.945789 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10bd0-5a43-48a5-a409-f2d23a1aaf92 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.946257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10bd0-5a43-48a5-a409-f2d23a1aaf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.947376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:32.948052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:32.952586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:32.952586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:32.952586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:32.952586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:32.952586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:32.964217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 366/729] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:32.976942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:32.980190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bfd10bd0-5a43-48a5-a409-f2d23a1aaf92 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:32.981584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bfd10bd0-5a43-48a5-a409-f2d23a1aaf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:33.101759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 364/730] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:33.108081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afc88-011b-4870-bf4c-926c1cff33e9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.108373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afc88-011b-4870-bf4c-926c1cff33e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.108648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6afc88-011b-4870-bf4c-926c1cff33e9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.113730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 365/731] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:02:33.115304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.115595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.115875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.118439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.136340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:33.137985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:33.139599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c79c-2125-47d5-bab0-cf9a693f86c9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.178129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.180921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.181833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.182142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.182417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.190876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:33.192404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:33.210159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:33.211928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:33.213035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:33.217474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 367/732] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:33.218390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.233827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 366/733] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:02:33.235079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.340030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9759d0-38b5-4890-b345-cb067d70a4c8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.346628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e66f2-21d7-4604-b3f7-730f60f99d0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.377500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.378597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.379116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.379585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.380614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:33.381115 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:33.381380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.382208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.382490 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.382761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.383696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:33.389873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.393473 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:33.401263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:33.402421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:33.403456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:33.410851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 368/734] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:33.410851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.413426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 367/735] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:33.414499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.447779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.515318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7bad9-d52c-4712-b69a-d6589ba5ced4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.527720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11c100-8b3c-458c-9e38-18f9dcb20064 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.552324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.553704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.553997 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.554359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.565702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:33.570577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.571390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.571668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.571943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.572702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:33.573010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:33.574417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc634-e90a-4335-add7-4bd35d3dab66 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:33.576071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:33.577099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:33.578190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:33.582312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 369/736] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:33.583417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.593175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 368/737] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:33.595931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ba798-757b-47e5-b69f-c77c9e4899d4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.596287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ba798-757b-47e5-b69f-c77c9e4899d4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.596655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ba798-757b-47e5-b69f-c77c9e4899d4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.598287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 369/738] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:33.599364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ba798-757b-47e5-b69f-c77c9e4899d4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.657767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.701372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.705152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49747cb8-a6f4-4b7e-92c6-635c94c79071 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.715751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ba798-757b-47e5-b69f-c77c9e4899d4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:33.742232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.742910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.743248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.743526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.749142 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:33.749820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.750133 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.750414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.751174 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:33.751484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:33.752869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b2bb-e1ec-4f6d-8ee0-7c148c1e8f57 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:33.767111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 370/739] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:33.767111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:33.767111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:33.767111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:33.783381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:33.784560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:33.812858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:33.814352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:33.865604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 371/740] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:02:33.873832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:33.874952 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.922007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 370/741] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:02:33.922007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:33.974591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.001578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440dc78-693b-4a4c-b819-80bc1129fe67 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.038336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76892d51-6698-4e3c-ae70-f03a128d105e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.040113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.041364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.041364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.041552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.052259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.053720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:34.072082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.073017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.073920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:34.073920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:34.073920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.073920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:34.073920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 372/742] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.074233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.080378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.081194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.081481 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.081757 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.092518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.093985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:34.111875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.112832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.113803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:34.113803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:34.113803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.113803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:34.117836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 371/743] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.118728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.130722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.181877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6fb0-c5d4-435c-b59c-aaaa8e94f11b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.218179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.225067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.225608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.225891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.226313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.226931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.228370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.230215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d927b1a-25f0-4489-a448-d9894b7e4100 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.245674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 373/744] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:02:34 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:34.247379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.277570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.279209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.279209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.279209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.291312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.292872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:34.313888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.314884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.315773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:34.315773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:34.315773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:34.315773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:34.320815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 372/745] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.321593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.396591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96957bc-0634-4e25-890b-5de90a66da25 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.400782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.435420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.436406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.436877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.437341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.438113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:34.438424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.439796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.445230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8fb39-d769-47da-99fb-9af4b2a76bee None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.452228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 374/746] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:34.453274 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.480737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.481330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.481612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.481888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.482656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:34.482965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.484341 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c6cf-7bc5-4897-8874-63ca1ba5ee43 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.495578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 373/747] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:34.496835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1b4a-bb5f-4875-ad4f-ddb16ac5c8e2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.497143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1b4a-bb5f-4875-ad4f-ddb16ac5c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.497420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1b4a-bb5f-4875-ad4f-ddb16ac5c8e2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.499035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 374/748] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:34.499744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b1b4a-bb5f-4875-ad4f-ddb16ac5c8e2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.511119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.565214 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb2d4b-d96b-429f-b2a5-7fd798b9c609 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.598548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.599248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.599501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.599776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.600658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:34.600968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.602383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.615612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 375/749] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:34.616372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.620719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b1b4a-bb5f-4875-ad4f-ddb16ac5c8e2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.639021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.657256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.658064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.658506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.658623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.668144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.669588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-3524bf47-2cec-4f5c-b395-6041f18b8e4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:34.684205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.685213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 375/750] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.687057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.687768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.704306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:34.705493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:34.725296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e7761-3600-40ba-a859-de09493560fb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.742477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.764846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.766064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.766441 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.766823 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.776123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.778026 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.780648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 376/751] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:34.781564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:34.798488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.799453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:34.800381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:34.802863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 376/752] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.803801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.886229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153de19-ed83-4ab2-a4c0-5f0d3076fbf2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.896357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:34.913723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a411efd-2d84-40e8-b809-f1464e9b41e4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:34.922349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.923289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.923634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.923974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.931099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.932550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:34.946745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:34.947621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:34.948494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 377/753] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:34.949589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:34.954723 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:34.955411 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:34.955698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:34.955972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:34.956828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:34.957133 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:34.958675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:34.983211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 377/754] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:34.983211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.016375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.058221 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854d52-710e-4ce5-b8cc-bea17e6f3289 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.088568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f91d7-0485-4957-a865-ca2763580d3e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.094709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.095531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.095810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.096079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.096725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.098162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:35.110582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:35.111509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:35.112359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 378/755] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:35.113306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.132341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.133054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.133341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.133619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.134507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.134825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.136271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.144526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.156085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 378/756] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.157222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.221104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae20294-7b8d-4357-8150-2d046c2296fd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.244179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.257635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbff14-a7cb-46c8-937e-281b34844623 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.257848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.258506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.258785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.259049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.259839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.260848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.261587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.278727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 379/757] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.278727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.298013 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.298845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.299126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.299398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.310521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.311894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:35.330198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:35.331103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:35.332007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:35.332007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:35.332007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:35.332007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:35.336252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 379/758] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:35.336979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.375338 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.384960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43cf0-a875-4dd6-bbd0-20a73590e2bb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.420768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.421434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.421712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.421985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.422722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.423028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.424393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.429124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 380/759] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.429812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.445491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf904d9-cfcd-48be-b853-8730cedf113d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.480908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.481565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.481847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.482154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.492677 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.531718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2553-2751-4528-8c39-820457e0e512 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.552161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.553653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.571023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.571676 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.571958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.572213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.573041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=7368871bcd14466cb7513218ad0f003c) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.573352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.574788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.590065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 381/760] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/role_assignments?user.id=7368871bcd14466cb7513218ad0f003c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.590065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.616734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.676270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 380/761] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:02:35.677262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.729130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.730977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a7e36-6f74-40ea-bcd3-d3d4f2b95467 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.775310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.776009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.776934 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.777212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.777951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.778309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.779697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.797138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 382/762] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.798217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092acfd-5859-4817-8655-d7424c6103b0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.798552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.846000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.847190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.847673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.848175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.849083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:35.849711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.851491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:35.862188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 381/763] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:35.863632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:35.905530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:35.930508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0491a4-d7c5-4265-a3ff-098154250b93 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.970751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1637-4853-4b2d-ad91-fd79aaec03b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:35.974424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:35.975242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:35.975519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:35.975787 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:35.990251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:35.992466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.002407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.011087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.012047 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.012373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.012727 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:36.015065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:36.015950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:36.016837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:36.016837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:36.016837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:36.016837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:36.018942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 383/764] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:36.019910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.028305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.030098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:36.046206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:36.047347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:36.048250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:36.053340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 382/765] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:36.054309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.141789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fa9b8-7094-49b0-9e84-d24cba5f43a1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.162488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678995e1-abcf-4150-ab9e-45abcd9e8098 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.179634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.185368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.186484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.187428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.188000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.189196 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] RBAC: Adding query filter params (interface=public, service_id=720c99a149e14bfcb51b9a89c504e341, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:36.189612 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.191648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.205750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 384/766] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/endpoints?service_id=720c99a149e14bfcb51b9a89c504e341&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:36.205750 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.207180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.208433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.209184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.209811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.211115 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:36.211613 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.213567 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.232809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 383/767] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:36.234247 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.267054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.312824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c43fa3-e5ba-4c46-8d47-c49836b18e23 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.357305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.358256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.358543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.358822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.361273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db1213-a4f9-4a39-8c13-74fcdb14b0c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.361700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:36.361700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.361700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.383762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 385/768] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:36.383762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.401398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.402084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.402370 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.402795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.403331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.404707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7a94-f0ce-4f3a-b316-a065877a5d31 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 384/769] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab2d6-94c3-43a7-8496-5671549c8210 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab2d6-94c3-43a7-8496-5671549c8210 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab2d6-94c3-43a7-8496-5671549c8210 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 385/770] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:36.418126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfab2d6-94c3-43a7-8496-5671549c8210 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.461374 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.518170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f8b80-dfdf-4f1b-8fc8-d56a9e93cff4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.518764 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.530536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfab2d6-94c3-43a7-8496-5671549c8210 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.567772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.568764 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.569049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.569572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.575488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.576482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.576825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.577235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.578148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.579453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=a71d566879c44440bc4675b59c6d54e1, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.579609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.581307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-892fe0dd-8dbb-431e-bd06-f4c2d80c68d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:36.596362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:36.597312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:36.598289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 386/771] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:36.599381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.599522 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.599660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.603895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 386/772] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:36 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:36.604177 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.621461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:36.622868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:36.730081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 387/773] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:36.755686 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.801055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74aa03-31ed-454c-9e69-991b0e1a03b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.834399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.842735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.843609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.843959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.844297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.845157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:36.846440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.848316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:36.864740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 387/774] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:36.870761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:36.882755 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:36.907009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1b2d-b9b8-4c45-bbfe-e306c88c12fa None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:36.987339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:36.988160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:36.988647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:36.988934 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] PATH_INFO: `/v3/services/network` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:36.989696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:36.991122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.005921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a186478-6fa8-40d2-9041-0d9cc2eaa677 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:37.018763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:37.019981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:37.020838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 388/775] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:37.028460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:37.054483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:37.055514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.055944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.056392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.057444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a6cb7e0a02644c76b2acd43e1717b1c8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:37.058249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:37.059896 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.066804 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 388/776] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:36 2022] GET /identity/v3/role_assignments?user.id=a6cb7e0a02644c76b2acd43e1717b1c8&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:37.234366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f142-d183-4024-b68f-a0f751738a0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:37.248034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:37.281536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:37.282260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.282546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.282830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.283569 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] RBAC: Adding query filter params (name=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:37.283880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:37.285332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.296190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 389/777] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:37.301464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:37.381627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:37.414874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de900cd-fd4a-460f-8c50-1bbecf899342 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:37.454626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:37.455316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.455602 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.455884 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.456611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:37.456926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:37.458368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.463819 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 389/778] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:37.469755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:37.618650 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e456e1-e6ef-44ef-bf88-c595c599165f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:37.671646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:37.672348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.672633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.672930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.673784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] RBAC: Adding query filter params (interface=public, service_id=4c24e8ed9f164eb989895358d15cfebd, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:37.674124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:37.675530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aab970-8673-4c2e-95f7-282b04ed76ba None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.687723 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 390/779] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:02:37 2022] GET /identity/v3/endpoints?service_id=4c24e8ed9f164eb989895358d15cfebd&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:37.694005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:37.819908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870480-bb59-465e-ab71-072bb5fc7eb1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:37.857678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:37.858490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.858778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.859056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.859752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:37.861153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eaa63-ad50-4fd7-afbc-cc0d74f07ee8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:37.863033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:37.869085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 390/780] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:37 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:37.963400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3f56-552a-4b0d-b377-b6b40dd71060 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.963921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3f56-552a-4b0d-b377-b6b40dd71060 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.964014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3f56-552a-4b0d-b377-b6b40dd71060 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.965611 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 391/781] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:37.971426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:37.971857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:37.972151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:37.990257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:37.991481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:38.066835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 391/782] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:38.098024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3f56-552a-4b0d-b377-b6b40dd71060 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:38.144183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:38.206254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3f56-552a-4b0d-b377-b6b40dd71060 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:38.244056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:38.244860 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.245136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.245407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.256261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:38.263703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:38.264672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:38.265528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 392/783] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:38.271306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:38.406116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb507a3-12d0-4c04-9649-b7577f6d00d4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:38.443956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:38.452274 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:38.452975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.453267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.453548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.454354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:38.455073 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:38.456478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:38.470587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 392/784] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:38.476306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:38.620340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:38.623933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90b2e-869b-4e70-917d-cf0950e65755 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:38.666836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:38.667562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.667846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.668120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.683596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:38.685061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-26a856e0-1fc9-4663-a2ab-bf29b04354d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:38.705719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:38.706665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:38.707710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:38.707710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:38.707710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:38.707710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:38.709437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 393/785] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:38.719213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:38.871038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598542-3ede-4136-8404-c3c71d3ca593 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:38.918417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:38.919027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.919312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.919643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.920393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:38.920707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:38.921405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945456f-3066-4dc3-8d36-92ac3d387d8b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.921696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945456f-3066-4dc3-8d36-92ac3d387d8b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.921981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945456f-3066-4dc3-8d36-92ac3d387d8b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.922097 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:38.927419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 394/786] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:38.929003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:38.929295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:38.929574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:38.940328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 393/787] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:38.945967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:38.961880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:38.963122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:39.066703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.106375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 395/788] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:39.136017 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.159467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886f5b7-f9b0-42f9-9619-64609521e1d9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.218999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.219817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.220095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.220363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.231175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.235335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:39.261466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:39.262513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:39.263501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:39.264598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 394/789] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:39.272465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.292588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.327052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670d069-895d-45c1-a885-f481d6142cfd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.407719 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.408783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.409069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.409730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.410738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.412738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.415330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a363df-2e5a-4aa8-862a-9e28670708cf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7245247a-80e0-4df0-a81d-7b0457e3cd22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:39.428077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:39.429080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:02:39.429961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:39.430856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.434123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 396/790] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:39.435542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674f19-e99d-4a27-9bcb-29275c91190a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.435830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674f19-e99d-4a27-9bcb-29275c91190a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.436111 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674f19-e99d-4a27-9bcb-29275c91190a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.437434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 397/791] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:39.438522 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c46b3-408a-4b84-a9d1-f51cb58be7c0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.438797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c46b3-408a-4b84-a9d1-f51cb58be7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.439075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c46b3-408a-4b84-a9d1-f51cb58be7c0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.443913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 398/792] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:39.443913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c46b3-408a-4b84-a9d1-f51cb58be7c0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.461161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.461932 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.462310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.462650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.463565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:39.463956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.465452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554cac0-6f41-4713-acb7-c513e2d83806 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.486184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 395/793] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:39.486184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298080a9-55e0-4e95-8102-e1676b065329 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.486184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298080a9-55e0-4e95-8102-e1676b065329 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.486184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298080a9-55e0-4e95-8102-e1676b065329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.502405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-298080a9-55e0-4e95-8102-e1676b065329 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:39.503573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-298080a9-55e0-4e95-8102-e1676b065329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:39.552688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c46b3-408a-4b84-a9d1-f51cb58be7c0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.573733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 396/794] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:39.574887 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.575181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.575460 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.591619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:39.592922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:39.598925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.599653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.599978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.600254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.601086 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:39.601416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.602813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.607489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 399/795] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:39.609014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.621260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.668512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 397/796] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:39.674968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.709660 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.718356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b734f-5aa6-4f1f-8500-71aa5ac8aee9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.751037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.751767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.752046 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.752318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.763759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.765203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:39.782261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:39.783160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:39.784070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:39.784070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:39.784070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:39.784070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:39.784070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 400/797] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:39.784346 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.787435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87b90e-9203-4e50-9a23-78211b22d7b5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.834183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.835078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.835447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.835785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.846720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:39.854644 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:39.855605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:39.856447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 398/798] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:39.857146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.857948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.903629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69620b-2884-4c30-b7bb-3d772728b93f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:39.939499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:39.940165 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:39.940441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:39.940815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:39.941722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:39.942188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:39.943562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:39.954250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 401/799] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:39.954410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:39.954832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:39.966198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5d12-2f5c-4efd-8cd4-a20b0e523ea5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.002522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.003352 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.003640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.003943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.014875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:40.023304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:40.024296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:40.025199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 399/800] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:40.026598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.066259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09458f-1c14-4462-920e-0173b38798bc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.092844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.105144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.105816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.106126 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.106401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.107240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.107765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.109028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.122204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 402/801] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.122807 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.133759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ada0-c8f5-4834-af1f-668b85bdbff6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.166231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.166913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.167198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.167475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.168229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.168540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.169925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.178770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 400/802] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.179570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.196648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.234287 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27b31-bc81-4b7a-8f72-73e35f6c3537 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.275822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.276515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.276830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.277104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.277849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.279262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.286182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac7b6-45c9-4196-914e-84c2f3794623 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.314067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 403/803] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:02:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:40.314067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.339355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.340041 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.340320 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.340614 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.341341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.341645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.343085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.356987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 401/804] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.356987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.360566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.430758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f8445-f704-4c2a-9bb9-13d0ed5ed784 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.434404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.468951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.469768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.470063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.470347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.472338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084f35b-3958-4e19-8dfc-b7d494a9ffbb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.478211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.479685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9cfab5f1-3505-48e0-ac16-6289c8976854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:40.495401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:40.496321 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:40.497199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 404/805] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:40.498257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e41-2009-4a3b-bb91-98755ff406df None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.498548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e41-2009-4a3b-bb91-98755ff406df None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.498822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e41-2009-4a3b-bb91-98755ff406df None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.500081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 405/806] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:40.500770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a65e41-2009-4a3b-bb91-98755ff406df None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.515114 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.515918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.516196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.516466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.526981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.528420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:40.548054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:40.549046 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:40.549920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:40.549920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:40.549920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:40.549920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:40.549920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 402/807] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:40.550692 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.606959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.612067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a65e41-2009-4a3b-bb91-98755ff406df None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.650340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.651145 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.651427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.651698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.652735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f8333-26f6-4246-99f3-9e01dabe5f09 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.662735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.664295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.675084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-48e939e6-f076-40a2-b2bb-1fb6cd1b35d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:40.683809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:40.684713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:40.685582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:40.685582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:40.685582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:40.685582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:40.685582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 406/808] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:40.686390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.686550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.686808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.693035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.693719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.694003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.694308 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.695107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.695421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.696870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.704871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:40.706351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:40.709711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 403/809] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.710775 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.786144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 407/810] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:40.786144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.832708 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2dcc-6fa3-45c3-9a15-dee098bd4b2c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.870933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.871616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.871899 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.872119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.872223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.873319 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.873645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.875218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.887138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 404/811] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.887998 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.897051 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7b0c-3767-4149-91a5-7987a5c9c83a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:40.933414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:40.935020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:40.936051 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:40.936577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:40.937025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:40.937898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:40.938401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:40.939790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:40.956839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 408/812] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:40.957836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:40.994482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f793-ca39-405f-991a-3f65eaf2c9f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.028396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.029312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.029593 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.029870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/7368871bcd14466cb7513218ad0f003c/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.032686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=7368871bcd14466cb7513218ad0f003c, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.034163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.048156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 405/813] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:40 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/7368871bcd14466cb7513218ad0f003c/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:41.048702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.073479 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199153c-805a-44ec-a9cf-2ab97445cf15 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.113235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.115009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.115470 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.115984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.116900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.118627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:41.132076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:41.133146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:02:41.134005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:41.136351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 409/814] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:40 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:41.137358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.148376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.187246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afeb0a-51fe-4a80-8982-47a0ebec9f7d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.189208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.229891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.230870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.231264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.231609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.240808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.242472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.249406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9fe-b93c-4099-84bb-833fce628dc4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:41.257615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:41.258776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:02:41.259935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:41.260925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 406/815] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:41.261765 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.295545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.296712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.297447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.297786 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.308786 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.310878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:41.332223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:41.334096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:41.335258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 410/816] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:41.336175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.376626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc542b-b944-4d94-b6a0-ce21e4bcd7b8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.416206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.417538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.417828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.418135 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.418861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:41.419171 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.420478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.421543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.429662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 407/817] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:41.435034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.465305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4383-29fb-4a12-97d8-22f30ee46fd1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.474380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.502951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.503753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.504133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.504477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.505395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:41.505710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.507204 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.525557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 411/818] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:41.526431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.565926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc5ba-7b01-4f50-8747-c4b35952f0be None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.602287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.602975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.603258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.603534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.604387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:41.604701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.606225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.628459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 408/819] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:41.628459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.640189 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c3fe-9977-4be5-b943-1cf58d73a4cf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.666802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.679522 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.680305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.680755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.681104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.681992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:41.682407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.684217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.694490 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 412/820] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:41.695507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.718895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.736616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ed39-0650-4277-845e-4dfbd3cfb46f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.772925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.773910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.774372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.774818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.802387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd87b4e-6810-41eb-99cb-63f32a1af3b0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:41.839077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:41.839969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:41.840323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:41.840670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:41.852279 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.853998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.856124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:41.857843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:41.872874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:41.874047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:41.875134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:41.875134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:41.875134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:41.875134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:41.880736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 413/821] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:41.881652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.931834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.951139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:41.969608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 409/822] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:02:41.970857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:41.994740 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75340f-a09f-4bb2-bf4c-f1af56024ac6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.029394 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.030222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.030613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.031024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.031847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.033290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.058551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 414/823] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:02:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:42.059617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.078172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aed6-7225-45f9-ad91-de65f1ddf53d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.122199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.123236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.123806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.124245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.125166 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:42.125677 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.127297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.140976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 410/824] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:42.146928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.194758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.234713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.249546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a1c8a-b19e-4420-9e75-079ac348f028 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.261513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d31b80-38ff-4d9d-9ec7-e1ca63cffe06 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.300700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.302080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.302591 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.303065 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.311399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.313228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.320296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.321124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.321431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.321703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:42.330203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:42.331139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:42.332056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:42.334902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 411/825] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:42.342500 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.343854 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.344043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a878d132-05c4-4984-80c5-1366822ad2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:42.362669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:42.363706 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:42.364880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:42.364880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:42.364880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:42.364880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:42.364880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 415/826] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:42.372110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaafca-9525-4b10-8d2d-3aac601526ce None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.372476 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaafca-9525-4b10-8d2d-3aac601526ce None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.372702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaafca-9525-4b10-8d2d-3aac601526ce None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.375148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 416/827] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:42.375970 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaafca-9525-4b10-8d2d-3aac601526ce None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.484684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.489106 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960762b-958d-4fdc-ace8-c7e255d3e2b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.514881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaafca-9525-4b10-8d2d-3aac601526ce None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.536525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.537199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.537484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.537792 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.538837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:42.539009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.540476 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9770-d310-4ed2-8b92-15a7d2ed81e3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.550958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.551734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.552116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.556939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.557088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 412/828] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:42.557185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:42.557185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.557341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.557341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.557504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.557590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.569067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 417/829] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:42.569974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.577498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:42.578728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:42.583334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.648377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 413/830] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:42.649169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.684725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f98f0-a67d-4d6d-a7b3-41aa2e0efeef None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.719358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.720263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.720545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.720820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a6cb7e0a02644c76b2acd43e1717b1c8/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.735708 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=a6cb7e0a02644c76b2acd43e1717b1c8, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.737169 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.742199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.751519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 418/831] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:42 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a6cb7e0a02644c76b2acd43e1717b1c8/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:42.752103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.764137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5185f-540a-454d-aae3-9b27b05c4f92 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.818781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.819623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.819909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.820188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.833559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:42.836821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.839549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:42.859445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:42.860424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:42.861332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:42.868989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 414/832] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:42.870948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:42.881182 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69a3cf-052c-49e5-a1b4-461c72db6a96 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:42.919794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:42.922093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:42.922093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:42.922093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:42.922093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:42.922848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:42.940187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:42.941331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:42.942578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 419/833] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:42.947725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.004522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f403-788c-478a-ac1e-008ad3555067 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.039596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.040298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.040550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.040828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.041624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:43.041939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.043948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.062398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae681-b233-4631-a4f7-10ede79001eb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.089803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:43.105043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.106175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.106650 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.107111 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.108098 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:43.108634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.110293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.116667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 420/834] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:43.129235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.178573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 415/835] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:43.185062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.198059 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:43.242541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28292-8416-4c87-97a0-b2572e092222 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.277234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.277907 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.278221 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.278497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.279210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:43.279518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.280886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee00ec9-c8cc-4725-b20d-5206d9c61abf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.285812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 421/836] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:43.287306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426347-92ce-4f2f-86b7-8767ea80f379 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.287799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426347-92ce-4f2f-86b7-8767ea80f379 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.288313 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426347-92ce-4f2f-86b7-8767ea80f379 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.290152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 422/837] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:43.295503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.295799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.296064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.304289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d74e8-a942-4620-a30f-efdb26e4a344 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.317432 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:43.319079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:43.343007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.344079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.344561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.345082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.346262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:43.346804 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.348637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.356486 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 416/838] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:43.382067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:43.405624 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 423/839] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:43.429951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.522454 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:43.545933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c886d-441e-48a7-bc40-8add883c3174 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.581038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.581849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.582197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.582476 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.593493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:43.601340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:43.602302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:43.603158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 417/840] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:43.608700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.709123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031f5ff-d13f-4ade-9925-0c3aa09ea417 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.743527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.744208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.744488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.744762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.745516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:43.745822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.747362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.756258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 424/841] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:43.761882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.871094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18c6d7-8537-4e1a-9aa8-07ede23f21c6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:43.906067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:43.906889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:43.907172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:43.907448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:43.909607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:43.921048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:43.922578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:43.942333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:43.943269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:43.944604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:43.944604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:43.944604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:43.944604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:43.944604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 418/842] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:43.949423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:43.995520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:44.053731 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddcc4a-56b8-4a4d-b289-e6d825d6f6bb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:44.088350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:44.089016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.089299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.089568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.090326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:44.090636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:44.092019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:44.104547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 425/843] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:44.109957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.211974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae0eb-8925-4d9e-904f-0c6dce55531b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:44.246752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:44.247897 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.248446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.248915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.257186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:44.258918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:44.273620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:44.274609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:02:44.275561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:44.281878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 419/844] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:44.284070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.387062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ea6b0-d71c-4869-bd21-ea7d1185ee53 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:44.389015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:44.422623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:44.423302 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.423582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.423854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.424702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:44.425013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:44.426503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:44.446491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 426/845] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:44.452249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.501658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:44.558926 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d4e92-1f47-4ea5-9822-56bc4b9acbac None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:44.596138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:44.596805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.597090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.597368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.675141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:44.677033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f015409-7e75-4ab2-815f-8b72b94ba30a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:44.726237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:44.785623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 420/846] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:02:44.791563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.835478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a299bd-2e1f-48cc-b443-f426ed9a2876 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.835767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a299bd-2e1f-48cc-b443-f426ed9a2876 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.836043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a299bd-2e1f-48cc-b443-f426ed9a2876 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.837706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 421/847] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:44.842421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.842700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.842973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.859857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:44.861029 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:44.901737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789fbc-969b-4297-aaae-84cb4d0a9b70 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:44.934324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 422/848] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:44.936627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:44.937499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:44.937845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:44.938205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:44.948721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:44.950267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:44.953755 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:44.969075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:44.970109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:44.971603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:44.971603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:44.971603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:44.971603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:44.971603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 427/849] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:44.976516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:44.991517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.037095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.062465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9fe7-bf1b-463f-bfe6-fd6e55baa2cb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.100948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.102096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.102514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.102923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.115084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:45.123475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:45.124661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:02:45.125678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:45.132837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 423/850] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:45.134060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.204487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af871f9-1413-4701-941e-35f2a5ee97df None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.238493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.238930 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13e59-2360-4768-a7b2-48ab88362381 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.239368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.239459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.239693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.240426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:45.240732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.242132 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.258980 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 428/851] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:45.259946 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.276938 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.277910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.278349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.278776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.279898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:45.280390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.281943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.294450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.295757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 424/852] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:45.296712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.331704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.363441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905f85d-96ca-4d21-acb5-58d7df83f055 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.400108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.401251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.401623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.401992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.404029 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744865c0-efac-44e2-9e3f-29fb934e70fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.409380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.411083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1b281a02-fb00-47e6-bfd5-6e78fad02e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:45.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:45.427642 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:45.428572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:45.434363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 429/853] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:45.434363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5c633-62ef-4ab2-a10c-a0416bb51bbe None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.434363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5c633-62ef-4ab2-a10c-a0416bb51bbe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.434363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5c633-62ef-4ab2-a10c-a0416bb51bbe None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.435389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 430/854] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:45.436150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5c633-62ef-4ab2-a10c-a0416bb51bbe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.441010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.441882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.442205 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.442479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.455010 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.456463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b4d0acc8-3cf3-4801-ac39-e54c92abfbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:45.473323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:45.474545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:45.475467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:45.475467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:45.475467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:45.475467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:45.475467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 425/855] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:45.476028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.476309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.476581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.494827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:45.496180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:45.544373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5c633-62ef-4ab2-a10c-a0416bb51bbe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.545517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.568787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 426/856] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:45.569557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.581561 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.587502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.588176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.588457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.588725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.589515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:45.589827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.591293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269648d-d2c4-401f-b63d-517a10c4a5ff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.603332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 431/857] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:45.604444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688870-c11c-4029-a245-caf6e2630fc4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.604737 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688870-c11c-4029-a245-caf6e2630fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.605012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688870-c11c-4029-a245-caf6e2630fc4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.606255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 432/858] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:45.606930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688870-c11c-4029-a245-caf6e2630fc4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.668735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467f886-1bf1-4be2-9b19-9b1d8c7b9929 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.703129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.703880 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.704231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.704574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.705375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:45.705759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.706345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688870-c11c-4029-a245-caf6e2630fc4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.707315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.719285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:45.719855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.740849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.741523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.741796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.742105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.742830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.744201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15624d82-10ae-46fc-993b-6ec664896043 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.757827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 433/860] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:02:45 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:45.759096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.759386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.759659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.775416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.779146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:45.780572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:45.834857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30364ac-f6fd-416f-98d5-dec0cc743a89 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:45.836115 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:45.868993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 434/861] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:45.869777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:45.883282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:45.884581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:45.885072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:45.885788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:45.887521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=7368871bcd14466cb7513218ad0f003c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:45.888191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:45.890302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:45.898785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 428/862] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/role_assignments?user.id=7368871bcd14466cb7513218ad0f003c&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:45.900191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.008277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3074-ec8c-4dbf-858c-d727c73a9ff9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.033752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007577-69e0-42c5-8250-7647f45af7b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.047918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.051312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.052334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.052793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.053200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.064842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.066833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.078393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.079149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.079433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.079725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.080383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.081826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:46.087447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:46.088734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:46.089729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 435/863] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:46.095432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:46.096379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:46.097203 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 429/864] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 11 20:02:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:46.102935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.103159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.157678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.224459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fdc5-deda-490c-b1eb-d9f2b2acaceb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.242338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f2cfe-0a58-494b-9b24-6e79e60ac8eb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.262346 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.263387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.263889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.264233 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.265162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:46.265538 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.267104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.285584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.286595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.287098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.287537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.288445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:46.288929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.290520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 436/865] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:46.290808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.291552 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.298012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 430/866] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:46.306643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.341353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.400069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.406754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737805-cae3-4a21-9a89-cc67adb8c711 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.416638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2a683-6504-4f58-ae04-a34b0fb98df1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.444885 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.445550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.446010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.446161 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.454054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.455101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.455573 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.456037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.457024 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:46.457586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.459587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.465855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 431/867] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:46.524376 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.525891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.630417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.638061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 437/868] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:02:46.643667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.742248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:46.748140 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503af9-1149-4145-b28e-d2a6193baf77 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.783420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.784240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.784572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.784850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.795841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.797295 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:46.815031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:46.815958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:46.816920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:46.816920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:46.816920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:46.816920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:46.816920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 432/869] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:46.822067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:46.937823 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a9d-889d-46ef-b45a-667ae53d97bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:46.973687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:46.974718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:46.975190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:46.975649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:46.976581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:46.977075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:46.978667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:46.991270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 438/870] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:47.001782 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:47.105733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ebdc3-998f-48ea-a50e-35fd76ef5799 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:47.143234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:47.144065 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:47.144349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:47.144662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:47.152249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:47.153710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:47.168452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:47.169326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:47.170232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 433/871] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:47.176950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:47.239133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:47.284574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674c0a-c247-448c-b63b-617fc9d92da1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:47.318731 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:47.319389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:47.319667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:47.319939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:47.320716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:47.321019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:47.322473 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59658242-60cf-4d86-b921-1ce7dad44256 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:47.334796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 439/872] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:47.340602 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:47.352155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:47.446710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e31a-5f21-42e8-8772-71519f5cdf3c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:47.484545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:47.485215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:47.485502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:47.485779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:47.486659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a6cb7e0a02644c76b2acd43e1717b1c8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:47.486970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:47.488455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687c62-2f3d-4190-b3b2-bab02b830dfb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:47.494980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 434/873] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:47 2022] GET /identity/v3/role_assignments?user.id=a6cb7e0a02644c76b2acd43e1717b1c8&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:47.844192 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2b38-c3a7-40c3-ae50-f8188c938595 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:47.844694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2b38-c3a7-40c3-ae50-f8188c938595 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:47.844797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2b38-c3a7-40c3-ae50-f8188c938595 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:47.846388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 440/874] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:47.851593 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ba83-6e67-4011-9a57-a43e99ff68c7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:47.851885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ba83-6e67-4011-9a57-a43e99ff68c7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:47.852167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ba83-6e67-4011-9a57-a43e99ff68c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:47.869146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1d82ba83-6e67-4011-9a57-a43e99ff68c7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:47.870393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d82ba83-6e67-4011-9a57-a43e99ff68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:47.942113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 435/875] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:47.959565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e2b38-c3a7-40c3-ae50-f8188c938595 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.072289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e2b38-c3a7-40c3-ae50-f8188c938595 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.090362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.109598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.110784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.111293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.111755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.112594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.114237 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.121325 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4388-21e1-417c-8c09-a83952740f17 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.121617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4388-21e1-417c-8c09-a83952740f17 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.121902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4388-21e1-417c-8c09-a83952740f17 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.124675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 436/876] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:48.127652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:48.128596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:48.129555 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:48.130317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.130317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.130317 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.132545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 441/877] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:48.137726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.138370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.151122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:48.152716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:48.238283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 437/878] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:48.253056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044398-fe35-4cc8-b000-2139784c82d1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.260379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.293987 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.294806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.295094 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.295369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.296080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:48.296386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.297940 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.308539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 442/879] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:48.310407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.357455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.371739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742c5f-bb1d-4b71-b97e-bc9caa8074af None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.402408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.411229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.413154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.414025 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.414521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.415372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.415951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d0ca-76f0-4c63-895f-9ae2f921fd93 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.417139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:48.434946 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:48.435989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:48.436826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:48.446074 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 438/880] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:48.448036 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.464405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.465223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.465518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.465809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.466921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:48.466921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.468712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.479746 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 443/881] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:48.481904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.578284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4707-63f2-4b5f-a7c0-92bd924e722f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.610159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35401-1100-49b1-b73a-04e46d478ffb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.620143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.624999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.625971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.626280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.626563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.627288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:48.627603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.629045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458cab4-242c-4003-8db7-fa5cacde067d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.634050 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 439/882] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:48.639574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a441ba3-49ba-47c4-8c33-136ee4d5d53e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.639867 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a441ba3-49ba-47c4-8c33-136ee4d5d53e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.640151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a441ba3-49ba-47c4-8c33-136ee4d5d53e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.641427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 440/883] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:48.642213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a441ba3-49ba-47c4-8c33-136ee4d5d53e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.655812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.656487 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.656772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.657045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.657850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] RBAC: Adding query filter params (interface=public, service_id=bf18ca2fcf3c440f9da1be3bd582643b, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:48.658212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.659597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b5fe0-ee7c-4def-ac3f-685fab0337c2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.665590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 444/884] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/endpoints?service_id=bf18ca2fcf3c440f9da1be3bd582643b&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:48.666968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.667255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.667556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.685014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:48.686250 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:48.713038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.754296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 445/885] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:48.755029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.767404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a441ba3-49ba-47c4-8c33-136ee4d5d53e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.806217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.807278 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.808033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.808457 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.809329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:48.809835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.811262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.819397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 441/886] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:48.820227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:48.889615 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f438-5050-464c-894d-9308a5bf6892 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.891422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:48.933392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:48.934196 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:48.935799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:48.936102 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:48.936828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:48.938270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca001-8caa-485f-8c20-af5f9c63a8d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:48.944979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 446/887] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:48 2022] GET /identity/v3/services => generated 1011 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:02:48.968322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac3b3-ab94-43e9-8fb7-c88e78261e28 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:48.995121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:49.007002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:49.007698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:49.007983 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:49.008264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:49.009000 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:49.010542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dfa8b-654e-44b9-973d-d17a1a7c2487 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:49.027725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 442/888] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:02:48 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:49.619503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036dced-0e52-4835-827e-8e85693f687c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:49.620196 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036dced-0e52-4835-827e-8e85693f687c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:49.620701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036dced-0e52-4835-827e-8e85693f687c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:49.622548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 447/889] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:49.628138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:49.629043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:49.629521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:49.646588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:49.648231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:49.723037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 443/890] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:49.746551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036dced-0e52-4835-827e-8e85693f687c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:49.855108 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036dced-0e52-4835-827e-8e85693f687c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:49.891469 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:49.892217 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:49.892496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:49.892768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:49.903425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:49.911922 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:49.912824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:49.913670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 448/891] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:02:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:49.919488 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.019366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32728e2-fba2-4906-9311-7aca85ccd5cc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.032754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:50.061445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.062207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.062491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.062767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.063525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:50.063837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.065221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.074612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 444/892] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:02:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:50.080338 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.110550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:50.189521 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322a76-caa2-4f38-8445-529a4dc406d4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.223846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.224653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.224930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.225253 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.236213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.237761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:50.257815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:50.258773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:50.259643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:50.259643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:50.259643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:50.259643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:50.259643 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 449/893] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:50.265254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.365696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24a81e-464c-4a29-a3f4-24bff646b5ea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.399567 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.400243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.400525 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.400802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.401536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:50.401845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.403255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.416319 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 445/894] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:50.421667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.502529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:50.524912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045105-1119-4d55-89b0-b7015a9c0849 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.560056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.560942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.561220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.561539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.569920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.571395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:50.586339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:50.587310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:50.588254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 450/895] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:50.593574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.625731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:50.696285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555999-90e9-4731-a63b-395461fb384b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.731895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.732992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.733477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.733954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.735044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:50.735556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.737192 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66351a5-4f06-4ed5-81b8-d31369d66e4c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.755834 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 446/896] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:50.763430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:50.867618 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00057ce4-4f69-4785-87f7-26b6a580119e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:50.901445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:50.902187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.902406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.902678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.911606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:50.956165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855406f-5595-4a69-8a15-d64481b3155c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.956497 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855406f-5595-4a69-8a15-d64481b3155c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.956759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855406f-5595-4a69-8a15-d64481b3155c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.962172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 447/897] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:50.963794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:50.964248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:50.964599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:50.973949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:50.975449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343d79-cad2-4897-aa2b-f38687dc2c00 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:50.982113 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:50.983483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:51.062239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:51.076872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 451/899] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:02:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:02:51.079905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.082731 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3906-6670-4c1a-af82-9ff402a78c9a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.083022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3906-6670-4c1a-af82-9ff402a78c9a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.083305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3906-6670-4c1a-af82-9ff402a78c9a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.084628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 452/900] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:51.085317 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3906-6670-4c1a-af82-9ff402a78c9a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.103262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.185414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604fc5-926b-496f-9c93-e947374718ec None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.186307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3906-6670-4c1a-af82-9ff402a78c9a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.220617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.221093 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.221408 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.221684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.221784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.221959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.222100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.222416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.223212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.224596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e03568-3963-4e04-986f-dd3545a0023b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.232499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.234007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.238954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 449/901] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:02:51 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:51.240190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1bf8-04e8-4855-86a3-02839bff7356 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.240474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1bf8-04e8-4855-86a3-02839bff7356 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.240770 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1bf8-04e8-4855-86a3-02839bff7356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-51b136a1-6c96-4ee3-8d4c-180e999a0b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:51.252530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:51.253720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:51.254836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:51.254836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:51.254836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:51.254836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.258829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 453/902] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:51.260388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc4-7ba4-481d-8603-5531d401908b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.260672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc4-7ba4-481d-8603-5531d401908b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.260947 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc4-7ba4-481d-8603-5531d401908b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.262540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 454/903] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:51.263207 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bc4-7ba4-481d-8603-5531d401908b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.273686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0dcb1bf8-04e8-4855-86a3-02839bff7356 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:51.274991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0dcb1bf8-04e8-4855-86a3-02839bff7356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:51.361170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 450/904] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:51.362289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.362577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.362848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.372125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.374636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.384903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:51.386651 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:51.389344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bc4-7ba4-481d-8603-5531d401908b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.429991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.430687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.430969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.431244 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.431974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:51.432285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.433976 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.445929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 455/905] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:51.446800 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.465803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 451/906] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:51.466519 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.564300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0683c-f89f-44ce-b231-54aa1b2d602c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.571002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce00248-91b6-442f-9644-1d055dbd9375 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.600080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.601061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.601639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.602127 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.602762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.604149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.605863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.606707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.606973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.607248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.610417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.615314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:51.617110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:51.618026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:51.624254 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.625042 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.625122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 456/907] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:51.625122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.641379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:51.641633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:51.642807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:51.643908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:51.644562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 452/908] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:51.650442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.739826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8835-e12d-421f-be51-b18300c26fce None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.760531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b58c69-cd42-452d-b977-0894f2e8a21b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.775567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.776360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.776647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.776923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.777583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.778988 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:51.791039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:51.792010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:51.792965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 457/909] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:51.794281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.805042 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.806492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.806983 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.807437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.809094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:51.809616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.811817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.822684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 453/910] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:51.822684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.890511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.891883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:51.912785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8807-cee7-468e-94fe-e77a0d63e22e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.937607 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f6755-ffe5-4c2f-9e10-4788df9d3080 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:51.946652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.947402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.947762 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.948040 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.948839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:51.949153 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.950618 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.962809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 458/911] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:51.963607 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:51.979259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:51.980098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:51.980389 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:51.981005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:51.981736 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:51.982098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:51.983472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:51.988986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 454/912] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:51.989611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:52.072831 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29487ad2-9462-46d9-ba4f-d317daf083fa None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.097105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60bc54-fd15-4698-904a-6ec950236c0a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.111068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.111806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.112078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.112271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.112972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:52.113498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.115012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.120168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:52.121075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 459/913] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:52.121903 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:52.124530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:52.135924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.136585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.136868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.137141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.137979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] RBAC: Adding query filter params (role.id=70db8a7b02e1449aa4fc4118ea814c7f, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a6cb7e0a02644c76b2acd43e1717b1c8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:52.138322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.139745 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.145725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 455/914] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:02:51 2022] GET /identity/v3/role_assignments?user.id=a6cb7e0a02644c76b2acd43e1717b1c8&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=70db8a7b02e1449aa4fc4118ea814c7f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:52.146362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:52.254637 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b982-d82c-4d44-afc5-a77fdc3391db None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.296417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901150a-4db6-4e1d-a3cc-c78966049c06 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.300390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.301144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.301430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.301710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.302484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:52.302799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.304193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.310179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 460/915] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 11 20:02:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:52.316337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:52.337186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.337847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.338163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.338434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.339343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] RBAC: Adding query filter params (interface=public, service_id=b6a00fab6f8143c28bb3c59eae44ce7c, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:52.339662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.341244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.350728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 456/916] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:02:52 2022] GET /identity/v3/endpoints?service_id=b6a00fab6f8143c28bb3c59eae44ce7c&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:52.357386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:52.414261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:52.418991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:52.463263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f30bb-72b4-41cc-b7a6-b832788383a1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.470580 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7115-1323-405b-8ff5-e38a31ad929e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:52.508845 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.509513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.509796 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.510098 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.510844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.512236 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94108fb2-c69d-44d3-b9e1-a248f857455f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.513250 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:52.514229 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:52.514705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:52.515133 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:52.516219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:52.518479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caf038-3e75-458d-8e00-00844c8bbbfe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:52.526684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 457/917] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:52 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:02:52.541928 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 461/918] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:02:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:53.268017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64235d-17c0-47b0-b3a3-4d7b551d3371 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:53.268544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64235d-17c0-47b0-b3a3-4d7b551d3371 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:53.268544 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64235d-17c0-47b0-b3a3-4d7b551d3371 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:53.270255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 458/919] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:53.275635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:53.276124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:53.276205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:53.293549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:53.294789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:53.373741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 462/920] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:53.396598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64235d-17c0-47b0-b3a3-4d7b551d3371 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:53.497991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64235d-17c0-47b0-b3a3-4d7b551d3371 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:53.514225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:53.532387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:53.533142 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:53.533430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:53.533712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:53.534592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:53.536128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:53.548617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:53.549595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:53.550459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 459/921] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:53.559136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:53.608571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:53.671780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b481-295e-4a01-8b2e-3ae6db5c604c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:53.709617 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:53.710324 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:53.710793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:53.711260 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:53.712327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:53.712639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:53.714010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:53.720203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 463/922] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:53.726083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:53.831104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375018e-7f13-4d93-a58e-f7293cdd970e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:53.868272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:53.868996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:53.869291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:53.869569 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:53.870312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:53.870620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:53.872009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:53.877407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 460/923] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:53.883128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:53.993687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7ae3-ef8e-4e91-b376-716a27ec07aa None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.010299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.035580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:54.036494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.036941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.037371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.038455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] RBAC: Adding query filter params (interface=public, service_id=d2ec1f325c1b40dea00bdd60e7c90a8d, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:54.038905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:54.040516 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927397-5e77-4e91-86c2-58ba3a0a2beb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:54.046814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 464/924] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:02:53 2022] GET /identity/v3/endpoints?service_id=d2ec1f325c1b40dea00bdd60e7c90a8d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:54.054944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:54.098954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.155434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a8f0-8a2c-4522-b4e1-cbbd4b17868e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.190839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:54.191583 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.191866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.192144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.192843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:54.194275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5ccb0-6b61-40eb-9b4c-077712e67ea7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:54.201077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 461/925] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:54 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:02:54.324710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b835-8c0a-4142-a545-032c2c52768a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.325272 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b835-8c0a-4142-a545-032c2c52768a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.325527 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b835-8c0a-4142-a545-032c2c52768a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.327362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 465/926] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:54.333215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada964-c546-416b-a38a-03f653e32b1d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.333743 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada964-c546-416b-a38a-03f653e32b1d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.333989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada964-c546-416b-a38a-03f653e32b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.356889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b1ada964-c546-416b-a38a-03f653e32b1d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:54.358068 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b1ada964-c546-416b-a38a-03f653e32b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:54.439914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:54.463698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b835-8c0a-4142-a545-032c2c52768a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:54.588880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b835-8c0a-4142-a545-032c2c52768a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.612409 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d913e-1187-4610-b1b4-0ada51077e09 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.612707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d913e-1187-4610-b1b4-0ada51077e09 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.612894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d913e-1187-4610-b1b4-0ada51077e09 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.614623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 463/928] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:54.619706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3728b-2760-4dc2-863a-674c24dfd5e5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.619991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3728b-2760-4dc2-863a-674c24dfd5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.620270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3728b-2760-4dc2-863a-674c24dfd5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.627836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:54.628755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.629038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.629309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.638941 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9e3728b-2760-4dc2-863a-674c24dfd5e5 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:54.640641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9e3728b-2760-4dc2-863a-674c24dfd5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:54.643827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:54.652387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:54.653349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:54.654226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 466/929] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:02:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:54.659397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:54.680871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.707075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.723222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 464/930] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:54.724662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1c92-c8d4-4ee6-a9a9-19d9b29844cf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.724961 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1c92-c8d4-4ee6-a9a9-19d9b29844cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.725232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1c92-c8d4-4ee6-a9a9-19d9b29844cf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.726684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 465/931] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:54.735261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.735547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.735862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.759018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:54.761664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:54.794396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038559-cd05-49bc-9792-d2f500468853 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.832603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 466/932] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:54.837588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:54.838310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.838592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.838876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.839550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:54.839654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:54.839930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:54.841312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:54.854194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 467/933] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:02:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:54.855073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:54.950663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.954818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9484a-426e-4fe9-9407-a9dc8de53e4a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.958680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:54.963099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f00c-ca0b-445b-8143-938df4570ed2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:54.991414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:54.992098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:54.992381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:54.992659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:54.993382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:54.994860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:54.996341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING keystone.server.flask.common [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 20:02:55.002264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.003097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.003378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.003682 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.004335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.006525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.015003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.sql.core [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:02:55.015003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 20:02:55.015003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [parameters: {'id': 'f6cd1617364f4e618657783b867d7bd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 20:02:55.015003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80498) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:55.019060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:55.020029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:55.020895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 468/934] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 11 20:02:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:55.021739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cd1617364f4e618657783b867d7bd7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cd1617364f4e618657783b867d7bd7. Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:55.036837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 20:02:55.037698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application yield resource Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise self.value Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application session.commit() Jul 11 20:02:55.038845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:02:55.039763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:02:55.042809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:55.046091 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [parameters: {'id': 'f6cd1617364f4e618657783b867d7bd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.048172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:55.050929 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cd1617364f4e618657783b867d7bd7. Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 467/935] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 11 20:02:54 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:55.053988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.132568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec68e5-b48e-4646-b28f-9292ead5b555 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.160393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54762ae-2b30-4b4a-8261-057dd9f51e5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.181145 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691f07-c815-4291-905e-16045c3834df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.181957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691f07-c815-4291-905e-16045c3834df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.182299 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691f07-c815-4291-905e-16045c3834df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.182548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691f07-c815-4291-905e-16045c3834df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.194659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691f07-c815-4291-905e-16045c3834df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.196121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691f07-c815-4291-905e-16045c3834df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.197526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.198393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.199008 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.199279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.200003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:55.200316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.201944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.215178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 468/936] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:55.215178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d8691f07-c815-4291-905e-16045c3834df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:55.215426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:55.216325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:55.217283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:55.217283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:55.217283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:55.217283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:55.217283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 469/937] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:55.219603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691f07-c815-4291-905e-16045c3834df None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.236977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.238386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.325577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec879ed-0b54-4962-a2d7-d1ac64ae5250 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.327038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691f07-c815-4291-905e-16045c3834df None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.364429 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.365309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.365437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.365624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.365899 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.366009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.366295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.366579 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.367308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:55.367621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.369318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.379220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 470/938] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:55.379385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.379485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.379580 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:55.394227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:55.395343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:55.396435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.401897 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 469/939] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:55.402720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.457491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.480069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8834-5971-41a4-aab6-ecad8001714b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.487931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.512438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1a4d0-c7bd-4267-9e25-70bf36db4fe0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.513843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.514629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.514977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.515307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.516095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:55.516462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.517888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.534557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:55.534557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.554822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.556600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.557068 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.557350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.558425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.560617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.594074 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 470/941] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:02:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:02:55.594074 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.659013 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a04e0-cfd3-47f0-bb82-d97944da6567 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.709558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155887-de75-427f-8571-b093e8512165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.710945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155887-de75-427f-8571-b093e8512165 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.711302 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155887-de75-427f-8571-b093e8512165 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.711646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155887-de75-427f-8571-b093e8512165 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.712776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155887-de75-427f-8571-b093e8512165 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:55.713156 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155887-de75-427f-8571-b093e8512165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.715848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155887-de75-427f-8571-b093e8512165 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.718780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.728638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d1e12-d116-41be-a4cd-0628509f2609 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.746292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:55.780311 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.781471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.781944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.782474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.785118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:55.793729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.795611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:55.814438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:55.815672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:55.816891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:55.819316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 471/943] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:55.825530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155887-de75-427f-8571-b093e8512165 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:55.939350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155887-de75-427f-8571-b093e8512165 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:55.974220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:55.974910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:55.975188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:55.975459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:55.976303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:55.976610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:55.978125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:55.996489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 473/944] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:56.002254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.105921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29f0-7cbe-4587-bb39-75f9601fa8c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.140561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.141657 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.142127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.142563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.154002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.155717 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3b0b7071-cce7-4057-880a-e037007dc06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:56.173658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:56.174817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:56.175957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:56.175957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:56.175957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:56.175957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:56.177817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 472/945] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:56.183896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.239673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.289135 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08802-d425-4847-9c49-8eb55c9719ee None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.289700 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08802-d425-4847-9c49-8eb55c9719ee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.290153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08802-d425-4847-9c49-8eb55c9719ee None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.292060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 473/946] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:56.292430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8220f-2fff-489d-93d0-2e5fdb51db9a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.300035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.300551 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.300989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.323779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:56.326239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:56.335113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.335915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.336284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.336651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.337944 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:56.338381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.340225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.355247 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 474/947] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:56.361785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.386243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.422332 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 474/948] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:56.440397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.479964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef5a79-3d4e-42f6-963f-8100c6702c3a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.493804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.520603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.522154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.522977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.523403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.532827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.534798 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.546577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7907-cd5a-4b37-8537-60ab88b7eae0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:02:56.554334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:56.555389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:02:56.556482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:56.563949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 475/949] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:56.564716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.596872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.598243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.599517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.600017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.600894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.602536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:56.618178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:56.619268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:56.620134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:56.622959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 475/950] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:56.629270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.681102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.683276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e35c6-2868-4eec-a13c-6960213c345f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.728212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.729281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.729712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.730425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.731848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:56.732573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.734460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.754052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 476/951] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:56.755461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.759989 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c67c3e-927c-4f7a-9f93-bfada869b504 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.790748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.806191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.807149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.807986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.808437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.809504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:56.810016 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.811777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.818273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 476/952] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:56.823482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:56.874354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00828e2-e1e4-440e-a229-0e36023a94c4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.909378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.910581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.911021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.911399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a6cb7e0a02644c76b2acd43e1717b1c8/roles/70db8a7b02e1449aa4fc4118ea814c7f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.913881 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=a6cb7e0a02644c76b2acd43e1717b1c8, role_id=70db8a7b02e1449aa4fc4118ea814c7f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.915455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.934351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 477/953] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:02:56 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a6cb7e0a02644c76b2acd43e1717b1c8/roles/70db8a7b02e1449aa4fc4118ea814c7f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:02:56.936645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d3d1-5851-4a7f-a1c3-322fe3d61208 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:56.940340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:56.984574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:56.985279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:56.985566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:56.985847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:56.986661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:56.986984 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:56.988597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53e41-767e-406c-a0ce-999ed79d0fdc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:56.995066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 477/954] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:57.000492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:57.111680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:57.122771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4aa3-4657-4b0e-8740-155301b6a3af None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:57.159266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:57.160330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:57.160811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:57.161262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:57.162215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:57.163781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d9e5-3a3b-4cce-9d7d-0c1fa41b04e1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:57.183900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 478/955] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:02:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:02:57.780863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fbf6-a319-4f14-ab64-45d3b1ddef27 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:57.781390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fbf6-a319-4f14-ab64-45d3b1ddef27 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:57.781498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487fbf6-a319-4f14-ab64-45d3b1ddef27 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:57.783295 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 478/956] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:57.788653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583c31-c765-48e9-9514-e836f441a564 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:57.789090 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583c31-c765-48e9-9514-e836f441a564 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:57.789276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583c31-c765-48e9-9514-e836f441a564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:57.806653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-42583c31-c765-48e9-9514-e836f441a564 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:57.808177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-42583c31-c765-48e9-9514-e836f441a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:57.859898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88964-867c-45ec-b111-7cd1129ba3a1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:57.860192 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88964-867c-45ec-b111-7cd1129ba3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:57.860445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88964-867c-45ec-b111-7cd1129ba3a1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:57.862069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 479/957] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:02:57.867037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:57.867324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:57.867598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:57.884401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:57.885582 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:57.897600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 479/958] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:57.918858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42583c31-c765-48e9-9514-e836f441a564 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:57.974451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 480/959] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:57.992144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:58.004302 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:58.035499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42583c31-c765-48e9-9514-e836f441a564 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.078280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.079092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.079374 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.079648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.080673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.082486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:58.097404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:58.098828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:58.100393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 480/960] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:02:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:58.105169 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:58.114446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:58.120595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35adac-55da-4226-bb56-c076fe7dd358 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.162524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.163261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.163541 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.163814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.164556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.166550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.183281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.sql.core [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:02:58.183281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 20:02:58.183281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [parameters: {'user_id': 'f6c7da131893452698ef1ce3fcfe177d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 20:02:58.183281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80498) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:58.193416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:58.194600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application yield resource Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise self.value Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application session.commit() Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:02:58.195627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:02:58.196558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:02:58.198109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:02:58.200194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6c7da131893452698ef1ce3fcfe177d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:58.202384 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 20:02:58.204271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 481/961] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 11 20:02:57 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:58.206433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:58.238999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44870-415d-4d48-810a-2f3b446a47b5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.289349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.290278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.290571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.291015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.291921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] RBAC: Adding query filter params (name=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:58.292241 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.294278 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.301152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 481/962] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:02:58.306570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:58.310588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:58.318832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11515-892e-4d8d-aac9-7f6bcbb151e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.360577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.362103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.363086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.363616 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.374581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.377157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:58.396539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:58.397515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:02:58.398543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:58.401418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 482/963] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:02:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:58.406738 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:58.427505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915ce2-018b-460f-a711-a54be2614ced None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.442572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:58.471991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.472718 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.473004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.473288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.474578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:58.474894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.476267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07bff6-4a1c-49b0-a7ef-b537ffeb8345 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.488112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 482/964] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:02:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:58.520641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea292-8ac4-483f-bcc2-1c0409fa575a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:58.560248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:58.560859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:58.561141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:58.561418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:58.562363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:58.562674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:58.564153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81925b79-7633-433f-bc79-59b556f53409 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:58.607994 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 483/965] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 11 20:02:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.017502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2f9a-face-44c3-829a-1d88f279b542 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.018104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2f9a-face-44c3-829a-1d88f279b542 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.018104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2f9a-face-44c3-829a-1d88f279b542 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.020736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 483/966] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:02:59.026067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7652-01d9-4579-9083-e28979238928 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.026497 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7652-01d9-4579-9083-e28979238928 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.026667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7652-01d9-4579-9083-e28979238928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.044043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e05d7652-01d9-4579-9083-e28979238928 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:59.045636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e05d7652-01d9-4579-9083-e28979238928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:59.116505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 484/967] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:02:59.139542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d2f9a-face-44c3-829a-1d88f279b542 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.212399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.224157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120404-16bb-4b17-bc67-35ade621af7c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.224446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120404-16bb-4b17-bc67-35ade621af7c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.224731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120404-16bb-4b17-bc67-35ade621af7c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.226290 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 485/968] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:02:59.230931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.231322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.231579 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.249033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:02:59.250341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:02:59.252505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.252634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d2f9a-face-44c3-829a-1d88f279b542 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.289734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.290582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.290866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.291142 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.302649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:02:59.311050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:59.311971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:59.312849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 484/969] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:02:59.318639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.324492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 486/970] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:02:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:02:59.346673 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.421381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de58a-58e8-41be-a7d1-5e8b729da02e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.447871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b76bd-f174-48d6-b6b3-b2baa750fdf0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.448996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.458901 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.459575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.459857 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.460141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.460889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:59.461201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.462614 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.471047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 485/971] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.476561 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.488175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.489300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.489730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.490213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.491149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.492797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:59.505997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:59.507224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:02:59.508277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:02:59.510645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 487/972] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:59.516437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.519464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.579212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add0800-f412-4615-b980-a151e3035a98 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.616216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.617046 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.617323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.617575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.624739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f170e7-7cc0-41bd-9bba-4e7de39fb91e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.628860 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.630330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:02:59.647790 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:59.648715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:59.649619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:02:59.649619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:02:59.649619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:02:59.649619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:59.649619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 486/973] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:02:59.654493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.662750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.663417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.663730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.664004 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.664719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:59.665033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.666455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.676164 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 488/974] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.677086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.700093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.744817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.760161 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3b459-7e43-4024-8151-b5e3c030aba2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.780287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbed77-65b2-424a-ad57-0df21bb1c45a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.797898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.798592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.798877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.799265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.800003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:59.800401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.801913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.812846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.813514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.813794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.814092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.814800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:59.815104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.816523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.824312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 487/975] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.824456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 489/976] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.826993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.828512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.923924 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.927696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026ba9-0b8e-4a12-835b-e9c49516a89b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.936910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136988a-3713-441f-9afd-28ee089aa7fb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:02:59.964965 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:02:59.965949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.966791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.967075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.967335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.971840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:02:59.972555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:02:59.972839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:02:59.973118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:02:59.973924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] RBAC: Adding query filter params (interface=admin, service_id=d2ec1f325c1b40dea00bdd60e7c90a8d, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:02:59.974269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.975503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:02:59.975668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.977009 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:02:59.981104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 490/977] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/endpoints?service_id=d2ec1f325c1b40dea00bdd60e7c90a8d&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:02:59.986352 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:02:59.992677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:02:59.993641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:02:59.999789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 488/978] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:00.000625 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.101102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a532f-8d19-4b43-95bb-2be1702f9bb8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.103272 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e349f0-24a4-4c38-95d4-32a34d301020 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.136794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.137547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.137841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.137963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.138290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.138539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.138822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.139096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.139372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:00.139744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.139842 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.141114 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.141438 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.148201 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 491/979] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 20:03:00.162834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 489/980] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 11 20:02:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:00.168572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.236303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:00.283959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d680b2-3341-4f04-bfa5-817c16ed5285 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.323221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.323885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.324168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.324444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.389973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.391470 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b2d4a-132f-413a-94ba-c8767be5e84c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.449063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:00.498856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 492/981] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:00.500356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.515233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d000-5608-4e9b-9cde-9b6af054c0ef None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.515517 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d000-5608-4e9b-9cde-9b6af054c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.515786 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d000-5608-4e9b-9cde-9b6af054c0ef None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.517439 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 493/982] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:00.522350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.522634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.523256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:00.523776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.543279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:00.544619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:00.603499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19e201-bd54-4920-8814-fd434d81ada0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.617280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 494/983] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:00.640251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.641287 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.641670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.641883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.642174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.655390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.656859 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:00.678230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:00.679337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:00.680428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:00.680428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:00.680428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:00.680428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:00.686940 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 490/984] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:00.687542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.739104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:00.753844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db7b9-1d74-43e5-a83a-ca31a446728c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.758328 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:00.789745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aa932-1b26-42eb-8001-1aebbcad8db8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:00.790816 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.791506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.791793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.792071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.792810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.794230 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.818412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 495/985] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:03:00 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:03:00.847122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:00.848184 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:00.848471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:00.848746 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:00.849509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:00.849822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:00.851283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:00.864567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 491/986] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:00.870210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:00.983667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237796e-cfb0-4465-9fd0-36053b7ba8ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:01.017504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:01.018291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:01.018576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:01.018852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:01.025999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:01.027536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:03:01.041837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:01.042752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:01.043641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 496/987] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:01.050639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:01.157225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991946e-4d1d-4bfd-bc9a-ac09c8130aed None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:01.182526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:01.193103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:01.193776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:01.194055 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:01.194355 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:01.195144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:01.195453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:01.196896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4165f36-451f-4444-b4ec-f3b8403e56ae None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:01.209316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 492/988] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:01.215184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:01.226509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:01.322417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde5df-d59b-4081-911f-d18f47752154 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:01.357376 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:01.358385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:01.358871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:01.359328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:01.360337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] RBAC: Adding query filter params (role.id=70db8a7b02e1449aa4fc4118ea814c7f, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a6cb7e0a02644c76b2acd43e1717b1c8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:01.360827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:01.362453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8427-3297-4c44-a832-f37364a369fb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:01.369156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 497/989] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:01 2022] GET /identity/v3/role_assignments?user.id=a6cb7e0a02644c76b2acd43e1717b1c8&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=70db8a7b02e1449aa4fc4118ea814c7f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:02.185729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df3d8-3833-4e60-89f8-788e1d477e37 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.186305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df3d8-3833-4e60-89f8-788e1d477e37 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.186305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df3d8-3833-4e60-89f8-788e1d477e37 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.187753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 493/990] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:02.192830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.193124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.193396 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.210216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:02.211395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:02.279516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 498/991] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:02.301956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df3d8-3833-4e60-89f8-788e1d477e37 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:02.405012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df3d8-3833-4e60-89f8-788e1d477e37 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:02.440128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:02.440851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.441190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.441460 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.442131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:02.443498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:02.455909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:02.456942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:02.457841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 494/992] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 11 20:03:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:02.463180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:02.465588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:02.573511 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb4f1-e49f-4ed5-9a8e-1a9368acaf3f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:02.607321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:02.607987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.608264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.608549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.609240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:02.609546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:02.610947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:02.620611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 499/993] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:03:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:02.621756 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:02.672161 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:02.723435 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1a6d6-461f-4232-94cf-f141b0aee2e7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:02.757221 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:02.757882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.758202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.758473 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.759179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:02.759481 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:02.760849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6eea5-3a84-4ecc-94ac-1f483c5a8c44 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:02.765908 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 495/994] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 11 20:03:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:02.771584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:02.846188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:02.855875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774971fe-f7d5-407e-a853-4ed9eb7c311d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.856152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774971fe-f7d5-407e-a853-4ed9eb7c311d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.856442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774971fe-f7d5-407e-a853-4ed9eb7c311d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.857929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 496/995] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:03:02.862757 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.863100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.863398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.880018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:02.881220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:02.882359 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2df6-c0db-4410-93ba-5e1530007a2c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:02.921109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:02.922713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:02.923227 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:02.923725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:02.925027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:02.926970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:02.944638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 500/996] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:03:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:02.958631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 497/997] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:02.981945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.100329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa637934-da14-4830-8d15-0779c6d6fa76 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.128695 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.138553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.139371 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.139658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.139932 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.140597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.141979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:03.153713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:03.154814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:03.155652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:03.158150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 501/998] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:03.161305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.206543 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.266999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38ec5d-b6d4-4a6c-9def-c54c5fdd042d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.303842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.304509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.304801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.305072 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.305792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:03.306127 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.307529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356082f-a063-4ffd-a9de-01ba8a319b9d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.313439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 498/999] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:03.319210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.419515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5cce-4383-4487-a4b7-3c100f6be6fc None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.419866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5cce-4383-4487-a4b7-3c100f6be6fc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.420087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5cce-4383-4487-a4b7-3c100f6be6fc None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.421669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 499/1000] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:03:03.425768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421ea7-64b3-44bb-9b66-8a79e83785e6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.426554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.426844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.427103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.445301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:03.446629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:03.461739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.462455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.462729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.463002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.463706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:03.464015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.465388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.470608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 502/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:03.476432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.513583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 500/1002] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:03.534001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.536429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.570061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.581953 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3ca6-c003-4117-90c1-a7531489b0a8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.616245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.616916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.617198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.617471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.618296 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] RBAC: Adding query filter params (interface=public, service_id=63e76e58fc71481db9ddf79e9926378c, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:03.618612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.620003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.629997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 503/1003] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/endpoints?service_id=63e76e58fc71481db9ddf79e9926378c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:03.631176 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.645102 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3b7f-f33e-478b-a5a1-136badf55932 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.680603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.681525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.681810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.682106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] PATH_INFO: `/v3/services/image` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.683069 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.684544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:03.696913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:03.703116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:03.704065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 501/1004] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:03.704870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.744889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e10f5-0003-447f-9bcd-00ee7e6ef9d1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.764566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.786394 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.787304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.787740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.788019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.788712 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.790101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.797622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 504/1005] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 20:03:03.806050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:03.813479 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e2ef2-10a5-4c9a-87c5-92a6d45fd647 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:03.853981 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:03.854712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:03.854992 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:03.855265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:03.855990 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] RBAC: Adding query filter params (name=image) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:03.856303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:03.857694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b77658-70b3-4379-8362-5d1cbab10483 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:03.868173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 502/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:03.869269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:03.977339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da8ef-90a1-4ef8-a90f-3f5dad49e851 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:04.011871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:04.012554 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:04.012835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:04.013092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:04.013830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:04.014175 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:04.015555 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542aec8-4b3d-4cff-a0b1-3081acbaa49b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:04.020542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 505/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:05.018301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b440-17c3-4468-920f-0da662894a9e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.018833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b440-17c3-4468-920f-0da662894a9e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.018833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b440-17c3-4468-920f-0da662894a9e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.020802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 503/1008] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:05.025956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.026446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.026535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.043344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:05.044528 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:05.088575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:05.117147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 506/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:05.140183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b440-17c3-4468-920f-0da662894a9e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:05.245231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b440-17c3-4468-920f-0da662894a9e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:05.279451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:05.280246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.280520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.280788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.281960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:05.283416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76663e-ea1d-4fc9-b2f8-6076162eca87 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:05.285388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 504/1010] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:05.290966 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:05.388309 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389f92-77f2-4ab9-9bc1-9cdb61bdfa99 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:05.422151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:05.422812 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.423094 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.423363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.424076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:05.425534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750966-08f6-4ce8-bcd1-0ad0bf435262 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:05.458078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 507/1011] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:03:05 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:05.817949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bd18-f6de-4825-840b-a142a2e7b0ea None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.818383 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bd18-f6de-4825-840b-a142a2e7b0ea None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.818609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bd18-f6de-4825-840b-a142a2e7b0ea None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.820016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 505/1012] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:05.825545 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a43a4-ba5e-4c7b-8794-b97cc071693d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:05.825784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a43a4-ba5e-4c7b-8794-b97cc071693d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:05.826023 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a43a4-ba5e-4c7b-8794-b97cc071693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:05.843071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3f2a43a4-ba5e-4c7b-8794-b97cc071693d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:05.844297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f2a43a4-ba5e-4c7b-8794-b97cc071693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:05.868339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:05.917689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:05.940849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4bd18-f6de-4825-840b-a142a2e7b0ea None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:05.974805 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:06.030224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f20b-26d4-4b0a-89f0-13ecb984c249 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.030739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f20b-26d4-4b0a-89f0-13ecb984c249 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.031246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908f20b-26d4-4b0a-89f0-13ecb984c249 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.032950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 509/1014] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:06.037924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.038260 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.038536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.051000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4bd18-f6de-4825-840b-a142a2e7b0ea None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:06.055730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:06.056914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:06.085048 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:06.085782 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.086083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.086357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.087020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:06.088382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:06.100223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:06.101256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:06.102120 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 506/1015] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:06.107483 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:06.127777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 510/1016] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:06.150404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:06.208098 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:06.214238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e45a-990b-4dd5-ba39-66f676bfeb16 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:06.242663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:06.248600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:06.249273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.249554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.249827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.250568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:06.250879 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:06.252245 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:06.256288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937ece5-1c53-4f16-bc96-9b7ff62ea12b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:06.257403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 507/1017] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:03:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:06.262800 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:06.293002 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:06.293676 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.293957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.294262 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.294990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:06.296368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:06.311911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 511/1018] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:03:06 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:03:06.376010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed190-789a-48de-abb9-a56d6ae0f49d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:06.418780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:06.419477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.419743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.420015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.420728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:06.421034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:06.422466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6e23-dc00-4df7-8246-e2b3f466543a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:06.428406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 508/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 11 20:03:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:06.434375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:06.538835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7c69-6a95-4224-96e3-6fb0831b2937 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:06.573263 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:06.573942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:06.574257 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:06.574536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:06.575307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:06.576703 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fd7ee-9e5f-40a6-927e-a2154ff75d2f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:06.598237 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 512/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:03:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:07.502264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d20b2-2562-4692-84c3-cf171591e5f8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:07.502780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d20b2-2562-4692-84c3-cf171591e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:07.502780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d20b2-2562-4692-84c3-cf171591e5f8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:07.504368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 509/1021] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:07.509705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:07.510138 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:07.510307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:07.516501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:07.528072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:07.529244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:07.602268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:07.625878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d20b2-2562-4692-84c3-cf171591e5f8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:07.647596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:07.736099 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d20b2-2562-4692-84c3-cf171591e5f8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:07.771096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:07.771820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:07.772105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:07.772381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:07.773563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:07.775038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec4cc-5b89-4aa4-b721-29997078b55c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:07.776681 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 510/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:07.782894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:07.894440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d6b3-594e-4d3f-9231-94c3c07d7df0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:07.924848 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:07.931763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:07.932442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:07.933035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:07.933305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:07.934052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:07.935515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931152-a55c-4858-a0c3-a5a0c06564be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:07.956724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 514/1024] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:03:07 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:03:08.341335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f99ba-53f0-49dc-9df9-4ccb31421a2e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.341741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f99ba-53f0-49dc-9df9-4ccb31421a2e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.341951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f99ba-53f0-49dc-9df9-4ccb31421a2e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.343427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 511/1025] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:08.348592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.348882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.349162 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.366092 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:08.367249 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:08.436372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 515/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:08.458856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f99ba-53f0-49dc-9df9-4ccb31421a2e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:08.549717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:08.569514 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f99ba-53f0-49dc-9df9-4ccb31421a2e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:08.604620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:08.605317 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.605613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.605884 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.606566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:08.607937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9970abeb-a086-4687-b52f-5f8f91ac9fd6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:08.619656 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:08.620689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:08.621541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 512/1027] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 11 20:03:08 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:08.627076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:08.703102 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77df13-56d7-4b86-b1af-fc13a96e0d00 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.703442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77df13-56d7-4b86-b1af-fc13a96e0d00 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.703659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77df13-56d7-4b86-b1af-fc13a96e0d00 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.705191 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 513/1028] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:08.710276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.710492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.710804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.727405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:08.728587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:08.733786 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a51a06-f258-4c84-a11d-4f9ea4d0388f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:08.750776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:08.770862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:08.771538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.771822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.772096 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.772801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:08.773112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:08.774527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:08.784055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 516/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:08.785314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:08.808213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:08.830858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:08.892931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c975b6e-d071-47f9-9de3-3d509a3daaeb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:08.915243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:08.926521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:08.927191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.927472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.927744 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.928453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:08.928761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:08.930155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:08.935498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 517/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:08.937752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581123-9036-4b3e-af94-9591c661d3f8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:08.941534 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:08.977187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:08.978017 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:08.978325 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:08.978597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:08.989962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:08.993463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:08.998198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:08.999154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:09.000044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 515/1032] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:03:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:09.005598 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.054767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada025-a131-451e-9815-71f054cc1bb0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.092992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.093748 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.093954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.094248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.095058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] RBAC: Adding query filter params (interface=public, service_id=dc2ff5d5ac6c4d42b6de421fc209dbd9, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:09.095373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.096788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.107269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 518/1033] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:03:08 2022] GET /identity/v3/endpoints?service_id=dc2ff5d5ac6c4d42b6de421fc209dbd9&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:09.108729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.118379 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5190-185e-4c3a-b5d2-774810c36d50 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.154775 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.155377 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.155660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.155935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.156688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:09.157001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.158406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.167822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 516/1034] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:09.173753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.176947 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:09.220043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98bb8-7101-47f2-8ecb-081fa684a65c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.229392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:09.256358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.257141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.257419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.257692 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.258537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.259899 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.278062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 519/1035] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 20:03:09.292933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c1a7-cbdf-4bb0-bf35-c4051cfc066a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.329959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.330797 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.331079 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.331351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.343271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.344780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:09.363594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:09.364572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:09.365475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:09.365475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:09.365475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:09.365475 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:09.369829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 517/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:09.370731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.477546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e136d-46bf-45bb-b1e4-8e1defe9d9da None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.511449 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.512125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.512403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.512705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.513423 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:09.513721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.515180 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.531577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 520/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:09.532765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.593307 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:09.641811 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861831-6a51-47fa-82be-2ee636d85432 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.676041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.676848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.677133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.677405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.685671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.687160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:03:09.701410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:09.702634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:09.703578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:09.706107 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 518/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:09.708512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.743099 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:09.819248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce928-37bf-4ad7-98bf-60147de2bb67 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.853463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:09.854226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:09.854506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:09.854779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:09.855661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:09.855971 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:09.857402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f684-cb38-4d96-974e-41178788c926 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:09.879716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 521/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:09.880953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:09.981091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe858-cffc-4e15-8a92-d08222e7961c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:09.996223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.006294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3cbe-a0d3-444f-b9a3-8cdfbd027958 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.006684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3cbe-a0d3-444f-b9a3-8cdfbd027958 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.007035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3cbe-a0d3-444f-b9a3-8cdfbd027958 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.008524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 522/1040] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:10.013757 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.014272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.014558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.017440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.018122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.018403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.018673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.031519 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:10.032728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:10.088828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.090308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.116111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 523/1041] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:10.139333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.162313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.195298 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 519/1042] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:03:10.197028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.215530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.243866 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d844-141c-4c91-927c-3755e96ce1fb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.278287 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.279018 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.279303 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.279575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.289891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:10.297653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:10.298769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:10.299647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 524/1043] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:10.305466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.319105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdf13-4f94-4e4e-a942-ad7a7fb0c3de None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.358205 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.359293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.359716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.360159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.373164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.374736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:10.392972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:10.394129 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:10.395158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:10.395158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:10.395158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:10.395158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:10.395158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 520/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:10.395991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.400033 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.418403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8e39-ffc9-444e-a9a9-58a907670448 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.455450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.456543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.457084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.457361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.458145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:10.458456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.460048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.463150 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.475715 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 525/1045] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:10.476747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.504080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3091833-a0fa-446a-aa24-193e9dcb267e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.541188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.541791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.542103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.542390 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.543124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:10.543465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.544843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.558074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 521/1046] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:10.562349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.583934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e1ce-0706-4ca4-a2e6-e84f0371886c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.622735 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.623620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.623899 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.624172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] PATH_INFO: `/v3/users/841a89b583334c3b94b1505e6a4d047f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.637253 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.640716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] RBAC: Authorizing `identity:get_user(user_id=841a89b583334c3b94b1505e6a4d047f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.642869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.645489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 526/1047] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/users/841a89b583334c3b94b1505e6a4d047f => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:10.650792 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.667670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47de6-1a05-4ec3-b33c-b1965380e4cc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.694780 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.704728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.705529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.705810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.706109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.713562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.715026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:03:10.730075 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:10.730996 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:10.731916 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 522/1048] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:10.736936 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.753500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bcc74-4171-440c-830a-4b9c9b12927a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.789055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.789709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.789988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.790292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.844411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae738d-aebd-4f24-bddb-e9091ed6656b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:10.865680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.868978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.870733 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.883157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:10.883816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:10.884203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:10.884482 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:10.885375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:10.885733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:10.887203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:10.900280 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 523/1049] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:10.906152 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:10.960436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:10.976931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 527/1050] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:03:10.977955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:11.025459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f87e-9bcf-443a-8a41-68aceb46a217 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.062854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.063520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.063804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.064081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.064921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] RBAC: Adding query filter params (role.id=70db8a7b02e1449aa4fc4118ea814c7f, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:11.065237 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.066758 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.078172 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 524/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=70db8a7b02e1449aa4fc4118ea814c7f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:11.086058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:11.089693 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe8b2-f061-496a-b699-46f97b505b74 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.127920 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.128937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.129215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.129484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.130907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.132392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6e046-fca2-4a8a-8a0d-f55067f60590 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.139382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 528/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:10 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:11.140404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:11.253501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea96e-c6a3-4d73-b04d-7fa26d851623 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.264137 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:11.286617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dd7ed-a7cc-46a3-952a-ec40c4ed7a34 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.286909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dd7ed-a7cc-46a3-952a-ec40c4ed7a34 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.287277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dd7ed-a7cc-46a3-952a-ec40c4ed7a34 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.288709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 529/1053] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:03:11.291478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.292139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.292422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.292697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.293531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=ad42f84db6a74373850709f64173e1f3, user.id=841a89b583334c3b94b1505e6a4d047f) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:11.293785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.293895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.294118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.294407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.295304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.302064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 525/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:11 2022] GET /identity/v3/role_assignments?user.id=841a89b583334c3b94b1505e6a4d047f&scope.project.id=ad42f84db6a74373850709f64173e1f3&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:11.312623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:11.313881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:11.394152 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 530/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:11.414224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:11.522696 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee607-852b-4e79-8fb8-1e20d470aa0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.558647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.559449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.559728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.560001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] PATH_INFO: `/v3/services/image` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.560655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.562049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:11.573717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:11.574752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:03:11.575632 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:11.578362 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 526/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 11 20:03:11 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:11.580909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:11.684465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:11.689066 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3e0ec-6645-42d4-ad81-54bcc99c4a71 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.725828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.726553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.726809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.727108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.727823 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:11.728137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.729507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.734945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 531/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:11.740593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:11.783977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:11.856597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc87aa0-3348-4ce3-adc6-1f058c9f7994 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:11.891087 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:11.891757 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:11.892035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:11.892308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:11.892999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] RBAC: Adding query filter params (type=image) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:11.893304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:11.894730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650817-3a76-4743-bb72-81cef42ca74d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:11.899895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 527/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:11.905503 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:12.011077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44df36-ae86-4cff-b1f8-83dcc599c446 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:12.047448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:12.048105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:12.048378 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:12.048659 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:12.049413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:12.050864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb08a45-2e53-4a13-911c-36c23174a952 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:12.070063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 532/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:03:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:13.045938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6c32-3376-40bd-8b8a-f936f611c6a3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.046535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6c32-3376-40bd-8b8a-f936f611c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.046535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6c32-3376-40bd-8b8a-f936f611c6a3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.048024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 528/1060] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:13.053404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a715-53ac-4a7f-b8b0-a78f3e991610 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.053841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a715-53ac-4a7f-b8b0-a78f3e991610 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.053918 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a715-53ac-4a7f-b8b0-a78f3e991610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.071067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-39d3a715-53ac-4a7f-b8b0-a78f3e991610 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:13.072243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-39d3a715-53ac-4a7f-b8b0-a78f3e991610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:13.086184 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.148082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 533/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:13.170173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf6c32-3376-40bd-8b8a-f936f611c6a3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.272289 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf6c32-3376-40bd-8b8a-f936f611c6a3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.273827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.297970 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e054-0ee1-41bb-997a-9b475abf0fea None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.298314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e054-0ee1-41bb-997a-9b475abf0fea None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.298558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e054-0ee1-41bb-997a-9b475abf0fea None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.300069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 534/1062] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:13.305933 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.306292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.306529 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.311335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.312141 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.312419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.312686 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.323490 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:13.323927 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:13.325117 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:13.331675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:13.332627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:13.333529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:13.337792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 529/1063] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:13.338926 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.406102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 535/1064] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:13.422508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.443768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d6fb8-7a10-4891-a15c-605182b894ff None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.479847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.480620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.481020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.481295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.482060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:13.482372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:13.483742 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:13.497035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 530/1065] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:13.497213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.498188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.525773 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea04afc-59f6-4f44-b407-e54a898204de None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.526301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.562655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.563456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.563734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.564009 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.574253 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:13.581878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:13.582945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:13.588811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 536/1066] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:13.589516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.612876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb665456-8ec7-41a1-a5ac-b97c74bc91d3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.649549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.650603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.651025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.651488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.663658 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:13.665431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:13.684286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:13.685339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:13.686345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:13.686345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:13.686345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:13.686345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:13.686345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 531/1067] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:13.691421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.696090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813389-dd5a-4731-8085-e91e4c71c057 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.730767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.731440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.731719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.731992 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.732738 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:13.733048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:13.734529 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:13.735894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.746095 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 537/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:13.750228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.779699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:13.803821 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26b41-dc37-472d-94d6-4c1f7143b6e6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.842710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.843607 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.844034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.844333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.845063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:13.845378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:13.846789 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:13.863319 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 532/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:13.864396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.867597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177be5c-b8d8-412b-8b4e-1a55ae04d6c6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.902491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:13.903379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:13.903658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:13.903932 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] PATH_INFO: `/v3/users/841a89b583334c3b94b1505e6a4d047f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:13.905270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=841a89b583334c3b94b1505e6a4d047f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:13.906840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:13.908675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 538/1070] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/users/841a89b583334c3b94b1505e6a4d047f => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:13.914498 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:13.964641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4917b0-8f4e-4726-bc67-e7448277bfb7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:13.979851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.001286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.002132 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.002416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.002690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.005785 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.010754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.012728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.022864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2acb-71b2-40ec-9c0a-68e4e9cbdfc8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:03:14.027802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:14.028826 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:14.029774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 533/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:14.034740 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.059399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.060461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.060786 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.061072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.062392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.063972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.065947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 539/1072] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:13 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:14.071816 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.140422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189be1-197b-465c-b1a6-b8c45dc9f1ae None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.170635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f93cc0-7ee1-4375-9e89-f9032868d9e0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.173812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.174563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.174848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.175153 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.176001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:14.176311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.177748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995356f-2966-4cf9-a2c2-5423f073bdf9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.197012 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 534/1073] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:14.198396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b167a2-039d-45b4-b11f-867243188ab3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.198679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b167a2-039d-45b4-b11f-867243188ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.198949 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b167a2-039d-45b4-b11f-867243188ab3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.200290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 535/1074] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:14.202631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.203735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b167a2-039d-45b4-b11f-867243188ab3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.208173 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.209080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.209364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.209648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3/users/841a89b583334c3b94b1505e6a4d047f/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.211692 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] RBAC: Authorizing `identity:create_grant(project_id=ad42f84db6a74373850709f64173e1f3, user_id=841a89b583334c3b94b1505e6a4d047f, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.213148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad4db-b22e-45b2-a619-091eaee8887c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.226694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 540/1075] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:03:14 2022] PUT /identity/v3/projects/ad42f84db6a74373850709f64173e1f3/users/841a89b583334c3b94b1505e6a4d047f/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:03:14.227895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.228199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.228463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.257902 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:14.259151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:14.266593 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.318440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b167a2-039d-45b4-b11f-867243188ab3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.340760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 541/1076] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:14.355363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.356282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.356626 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.356961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.363044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.368732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.370227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:14.390074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:14.391262 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:14.392352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:14.392352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:14.392352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:14.392352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:14.392352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 536/1077] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:14.397234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.477635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1ee5-cd60-476f-866a-9b1a36474cea None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.499609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.502665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55492d3-9749-4e9d-a43b-95d40d80b2ce None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.510836 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.513927 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.514643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.514923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.515198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.541295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.542265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.542691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.543105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.543973 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:14.544517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.546119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.562829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 537/1078] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:14.563866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.587587 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.589291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.669628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5f2d9-dfbe-4c65-b7ca-e9acef798770 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.695549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 542/1079] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:03:14.701342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.707938 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.708741 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.709019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.709690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.717264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.718792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.727161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:03:14.733382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:14.734477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:14.735391 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 538/1080] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:14.740427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.768484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.810226 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91b086-cd59-4c13-a3db-6c6d348650ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.848334 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f4a5-67be-42c1-8c0b-41e01bee6535 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:14.852985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.853796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.854216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.854389 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.865754 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.867246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.884504 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:14.884750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:14.885761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:14.886813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:14.886813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:14.886813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:14.886813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:14.886813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 543/1081] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:14.887754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:14.888032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:14.888303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:14.889086 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:14.889397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:14.890851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:14.892315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.903606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 539/1082] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:14.909326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:14.979466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:14.995989 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:15.008355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab033-ce66-4808-aee7-9c18cf5671b2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:15.011337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84610-8e7f-4b38-abf9-4a7ba5e21a39 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:15.043397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:15.044069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:15.044293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:15.044408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:15.044621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:15.045176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:15.045356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:15.045449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:15.045670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:15.045771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/70db8a7b02e1449aa4fc4118ea814c7f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:15.047225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b5fb3-55b8-490b-a658-676697542757 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:15.047894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=a71d566879c44440bc4675b59c6d54e1, role_id=70db8a7b02e1449aa4fc4118ea814c7f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:15.049314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84b50f-43ef-4c42-8d5d-404e6ba57bf2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:15.060400 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 544/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:15.070096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 540/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:03:14 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/a71d566879c44440bc4675b59c6d54e1/roles/70db8a7b02e1449aa4fc4118ea814c7f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:03:16.222839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331a6c-0d11-425c-a932-e88c24ac050c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.223402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331a6c-0d11-425c-a932-e88c24ac050c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.223402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331a6c-0d11-425c-a932-e88c24ac050c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.224796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 545/1085] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:16.230267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.230675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.230894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.248601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:16.249837 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:16.319459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:16.342907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62331a6c-0d11-425c-a932-e88c24ac050c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:16.446474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62331a6c-0d11-425c-a932-e88c24ac050c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:16.480304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:16.481033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.481316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.481610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.483472 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:16.492951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:16.500531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:16.501618 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:16.502640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 546/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:16.507939 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:16.586806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:16.610941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98d04-1d32-4554-ade1-e01bc84671f3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:16.650732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:16.651436 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.651713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.651983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.652733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:16.653043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:16.654464 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:16.663261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 542/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:16.669264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:16.770306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd41ac-6014-4392-b0b6-a7eca37b0084 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:16.804769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:16.805649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.805924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.806214 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] PATH_INFO: `/v3/users/841a89b583334c3b94b1505e6a4d047f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.807442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] RBAC: Authorizing `identity:get_user(user_id=841a89b583334c3b94b1505e6a4d047f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:16.809217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497587-5621-4b25-9777-a9d3c7feefa8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:16.813479 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 547/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:16 2022] GET /identity/v3/users/841a89b583334c3b94b1505e6a4d047f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:16.816959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:16.917041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dee64-f9f5-4ec6-8e95-3bf9b6320176 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:16.951745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:16.952413 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:16.952693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:16.952964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:16.962832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.022682 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.024065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.099576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e05a2-3902-4de6-a486-b227af9f1724 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.099826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e05a2-3902-4de6-a486-b227af9f1724 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.100123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e05a2-3902-4de6-a486-b227af9f1724 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.101758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 548/1090] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:17.106592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.106875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.107238 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.123791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:17.123963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 543/1091] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:17.124980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:17.129855 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.168228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.179075 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.191888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 549/1092] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:17.215222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.227848 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca6cb-54f5-4f29-974a-5a90735f8a66 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.264808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.265788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.266106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.266395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.267649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.269101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.270905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 544/1093] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:17.277078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.318625 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c18b0-b5da-4e81-9624-66a2313acdf0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.354156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.355232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.355489 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.355755 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.366395 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:17.374505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71035a67-4d12-4041-8a3f-cf60fa6322be None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:17.374640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:17.375713 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:17.376565 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 550/1094] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:17.381854 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.383613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.410974 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.411638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.411923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.412203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.413039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=ad42f84db6a74373850709f64173e1f3, user.id=841a89b583334c3b94b1505e6a4d047f) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:17.413356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.414828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.433854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 545/1095] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/role_assignments?user.id=841a89b583334c3b94b1505e6a4d047f&scope.project.id=ad42f84db6a74373850709f64173e1f3&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:17.434093 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.485617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e1da-679d-450c-a871-a507f28a65ee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.522882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.523568 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.523852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.524127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.524891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:17.525199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.526643 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.535850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 551/1096] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:17.542620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.646819 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfdc8-e226-4e6f-b0d6-f9ebdfc9252a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.680370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.681163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.681444 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.681722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.692693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.694179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:17.711455 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:17.712369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:17.713275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:17.713275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:17.713275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:17.713275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:17.713275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 546/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:17.718575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.824678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f054a-efe9-4669-89c9-240b2a788343 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:17.840406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.862313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:17.863072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:17.863356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:17.863634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:17.864364 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:17.864675 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:17.866071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:17.878406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 552/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:17.884208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:17.910222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:17.986832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5dda0-2c5f-4fe2-abc7-7ccf744d8c43 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:18.019692 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:18.020488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:18.020771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:18.021044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:18.029213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:18.030714 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:03:18.044565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:18.045567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:18.046577 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 547/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 11 20:03:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:18.051815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:18.150452 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7dc4a-4156-49af-8234-b354f943eff9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:18.185533 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:18.186223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:18.186474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:18.186773 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:18.187604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:18.187910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:18.189346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:18.206619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 553/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 11 20:03:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:18.212393 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:18.294697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:18.313511 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72ac4-7cc1-4f24-ae99-1520054939fc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:18.346824 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:18.347470 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:18.347748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:18.348018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:18.415509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:18.416876 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:18.500166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:18.523532 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 548/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:18.529344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:18.563210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:18.631453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0196-e87f-4462-8ff0-c39424b198c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:18.665188 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d843-c41e-4604-8688-68250029885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:18.666067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d843-c41e-4604-8688-68250029885a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:18.666281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d843-c41e-4604-8688-68250029885a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:18.666552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d843-c41e-4604-8688-68250029885a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:18.676699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d843-c41e-4604-8688-68250029885a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:18.678169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d843-c41e-4604-8688-68250029885a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e340d843-c41e-4604-8688-68250029885a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:18.696038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:18.696956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:18.697855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:03:18.697855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:18.697855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:03:18.697855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:18.697855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 554/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:03:18.703053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:18.804686 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c7aa8-5bf2-4b63-a3c0-cd2c3f64fc97 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:18.842556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:18.843220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:18.843501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:18.843771 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:18.844493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:18.844800 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:18.846194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:18.857626 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 549/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:18.863344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d843-c41e-4604-8688-68250029885a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:18.951334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:18.967877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d843-c41e-4604-8688-68250029885a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:19.002416 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:19.003275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.003556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.003815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.010602 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:19.012032 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:03:19.025791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:19.026825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:19.027728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 555/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:19.032963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:19.077883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:19.145024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a256-845a-4833-b70a-bb0950e3d4d5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:19.179437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:19.180101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.180378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.180653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.181442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:19.181753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:19.183583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f81-a73f-4abc-8568-c093a509fb3b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:19.195402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 550/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:19.201532 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:19.304705 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe391-7064-406f-9a8a-8f44757a450b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:19.346427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:19.351611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.351611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.351611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.351611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] RBAC: Adding query filter params (role.id=70db8a7b02e1449aa4fc4118ea814c7f, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=a71d566879c44440bc4675b59c6d54e1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:19.351611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:19.352720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a380-2a9b-44aa-a10d-018ed016e8ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:19.363840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 556/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:19 2022] GET /identity/v3/role_assignments?user.id=a71d566879c44440bc4675b59c6d54e1&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=70db8a7b02e1449aa4fc4118ea814c7f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:19.493004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b4a7-57e3-49e4-9839-c922852eadcc None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.494165 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b4a7-57e3-49e4-9839-c922852eadcc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.494447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b4a7-57e3-49e4-9839-c922852eadcc None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.495866 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 551/1107] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:19.502087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.502361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.502672 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.522635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:19.524129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:19.526847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:19.594599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 557/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:19.619163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1b4a7-57e3-49e4-9839-c922852eadcc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:19.726365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1b4a7-57e3-49e4-9839-c922852eadcc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:19.727906 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:19.763648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:19.764375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.764659 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.764932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.766148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:19.767590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d906cbd-55bd-4a49-91e1-c2541752a698 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:19.769311 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 552/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:19.775271 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:19.881846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4265-98e5-4724-bf32-e938f3a72564 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:19.914824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:19.915506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:19.915794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:19.916072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:19.916796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:19.918418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a90de-b357-486c-b11e-59a39dd557a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:19.927156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:19.942470 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 558/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:03:19 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:22.008710 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9f87-bc30-4ef7-a340-e57d77b17a6f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.009535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9f87-bc30-4ef7-a340-e57d77b17a6f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.009535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9f87-bc30-4ef7-a340-e57d77b17a6f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.011803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 553/1111] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:22.019927 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.020315 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.020490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.039963 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:22.041172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:22.111741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 559/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:22.135675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e9f87-bc30-4ef7-a340-e57d77b17a6f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:22.247813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e9f87-bc30-4ef7-a340-e57d77b17a6f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:22.282472 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:22.283326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.283609 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.283886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] PATH_INFO: `/v3/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.285434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] RBAC: Authorizing `identity:get_role(role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:22.286856 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:22.288212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 554/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:22 2022] GET /identity/v3/roles/d9bf441543c64c42a197b79c49c8b17e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:22.294195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:22.395863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac98e-fc50-483a-b771-16e8aebbf9bf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:22.419596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:22.440310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:22.441341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.441624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.441900 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] PATH_INFO: `/v3/users/496cb3c6634a450faa738e082d14f078` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.456648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] RBAC: Authorizing `identity:get_user(user_id=496cb3c6634a450faa738e082d14f078)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:22.458108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:22.459769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 560/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:22 2022] GET /identity/v3/users/496cb3c6634a450faa738e082d14f078 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:22.465566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:22.507303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:22.573292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea4db-d1ef-48b5-843c-f06fb3402924 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:22.609304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:22.609951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.610266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.610539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.682566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:22.684275 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:22.723665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:22.790355 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 555/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:22.796474 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:22.918887 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8025-6702-4723-a8ea-3d23e4c39235 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:22.953832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:22.954655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:22.954930 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:22.955199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:22.956601 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:22.958053 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667538be-d10f-467a-b257-990fd2b6e29f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:22.959739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 561/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:22 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:22.966139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:23.070078 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ae904-932d-4c88-87d6-0f17326a76a0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:23.104813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:23.105463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:23.105747 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:23.106026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:23.106898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=ad42f84db6a74373850709f64173e1f3, user.id=496cb3c6634a450faa738e082d14f078) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:23.107218 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:23.108667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c07384-a487-4166-b44c-892d9351900a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:23.114358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 556/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:22 2022] GET /identity/v3/role_assignments?user.id=496cb3c6634a450faa738e082d14f078&scope.project.id=ad42f84db6a74373850709f64173e1f3&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:25.086434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2522-d0c7-4d20-bcd6-0cad13ae9fbe None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.086957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2522-d0c7-4d20-bcd6-0cad13ae9fbe None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.086957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2522-d0c7-4d20-bcd6-0cad13ae9fbe None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.088292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 562/1118] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:25.094685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.095443 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.095571 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.104506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:25.120513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:25.121704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:25.196720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 557/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:25.226438 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2522-d0c7-4d20-bcd6-0cad13ae9fbe None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:25.285198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:25.338495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2522-d0c7-4d20-bcd6-0cad13ae9fbe None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:25.373596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:25.374477 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.374753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.375026 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] PATH_INFO: `/v3/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.376585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] RBAC: Authorizing `identity:get_role(role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:25.378063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:25.379422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 563/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:25 2022] GET /identity/v3/roles/d9bf441543c64c42a197b79c49c8b17e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:25.386028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:25.505185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356371fb-4274-4f52-b19b-12fd67fc820d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:25.547273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:25.559295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:25.560174 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.560458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.560729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] PATH_INFO: `/v3/users/496cb3c6634a450faa738e082d14f078` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.565897 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] RBAC: Authorizing `identity:get_user(user_id=496cb3c6634a450faa738e082d14f078)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:25.567375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:25.569019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 558/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:25 2022] GET /identity/v3/users/496cb3c6634a450faa738e082d14f078 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:25.575137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:25.685509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a5443-b07d-420f-b453-a02cce149c54 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:25.703349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:25.721721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:25.722776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.723105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.723407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.724813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:25.726521 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c38de-49c2-4b09-bc4f-f31134f25edc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:25.728408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 564/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:25 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:25.735458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:25.842257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5047-fcba-4521-b874-228ad2c7848d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:25.881616 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:25.882551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:25.882835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:25.883110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3/users/496cb3c6634a450faa738e082d14f078/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:25.885698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] RBAC: Authorizing `identity:create_grant(project_id=ad42f84db6a74373850709f64173e1f3, user_id=496cb3c6634a450faa738e082d14f078, role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:25.887197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ab68e-b80a-4488-8f1e-dc83a8b2d2ce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:25.903517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 559/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:03:25 2022] PUT /identity/v3/projects/ad42f84db6a74373850709f64173e1f3/users/496cb3c6634a450faa738e082d14f078/roles/d9bf441543c64c42a197b79c49c8b17e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:03:27.854374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b6ea-e438-4ed2-aab8-527b418e251d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:27.854879 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b6ea-e438-4ed2-aab8-527b418e251d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:27.854879 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b6ea-e438-4ed2-aab8-527b418e251d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:27.856289 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 565/1124] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:27.864466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:27.864874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:27.865021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:27.884051 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:27.885252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:27.950279 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:27.963448 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 560/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:27.990966 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9b6ea-e438-4ed2-aab8-527b418e251d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:28.113922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9b6ea-e438-4ed2-aab8-527b418e251d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:28.148710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:28.149556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:28.149838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:28.150132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] PATH_INFO: `/v3/roles/d9bf441543c64c42a197b79c49c8b17e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:28.151610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] RBAC: Authorizing `identity:get_role(role_id=d9bf441543c64c42a197b79c49c8b17e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:28.152993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:28.154403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 566/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:27 2022] GET /identity/v3/roles/d9bf441543c64c42a197b79c49c8b17e => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:28.160726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:28.282738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c2041-705e-401e-816a-7d1b89338ac9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:28.328348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:28.329644 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:28.330023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:28.330424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] PATH_INFO: `/v3/users/496cb3c6634a450faa738e082d14f078` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:28.332263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=496cb3c6634a450faa738e082d14f078)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:28.333720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:28.335415 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 561/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:28 2022] GET /identity/v3/users/496cb3c6634a450faa738e082d14f078 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:28.341329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:28.399906 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:28.450817 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab2bf-b5a8-4af4-8612-70fbcffd5ae1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:28.488356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:28.488990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:28.489270 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:28.489543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:28.556678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:28.558478 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:28.612118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:28.657663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 567/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:28.664422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:28.734957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:28.784904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801265c-814e-4b46-9c33-c9bf19c64ed3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:28.825190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:28.826062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:28.826372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:28.826647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] PATH_INFO: `/v3/projects/ad42f84db6a74373850709f64173e1f3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:28.828420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ad42f84db6a74373850709f64173e1f3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:28.830770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb32d-e750-49ea-8129-a11d2b46ecd8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:28.833014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 562/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:28 2022] GET /identity/v3/projects/ad42f84db6a74373850709f64173e1f3 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:28.839414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:28.946204 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6b75-3ec1-4721-a19f-cb452666c8af None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:28.979837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:28.980482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:28.980766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:28.981043 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:28.981877 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] RBAC: Adding query filter params (role.id=d9bf441543c64c42a197b79c49c8b17e, scope.project.id=ad42f84db6a74373850709f64173e1f3, user.id=496cb3c6634a450faa738e082d14f078) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:28.982223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:28.983669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad81a0-2049-4f1c-8c83-3958460b4d26 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:28.989830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 568/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:28 2022] GET /identity/v3/role_assignments?user.id=496cb3c6634a450faa738e082d14f078&scope.project.id=ad42f84db6a74373850709f64173e1f3&role.id=d9bf441543c64c42a197b79c49c8b17e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:30.990345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23fa1-9b5f-4b3d-9c67-f87e9cae3919 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:30.991203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23fa1-9b5f-4b3d-9c67-f87e9cae3919 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:30.991203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23fa1-9b5f-4b3d-9c67-f87e9cae3919 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:30.993380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 563/1131] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:31.002015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:31.002468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:31.002651 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:31.026626 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:31.027850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:31.041273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:31.097261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 569/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:31.121277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23fa1-9b5f-4b3d-9c67-f87e9cae3919 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:31.236584 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23fa1-9b5f-4b3d-9c67-f87e9cae3919 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:31.262975 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:31.275417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:31.276218 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:31.276510 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:31.276792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:31.278144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:31.279604 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36435d-e8d9-42d5-ad9c-1d82466c0a55 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:31.281237 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 564/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:31.287412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:31.400419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd510f34-9ed5-43a8-8230-5ea39e27294d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:31.437959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:31.438649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:31.438935 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:31.439216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:31.439938 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:31.441454 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37c409-8417-4bee-a81b-1d317e8abb6c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:31.465421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:31.473392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 570/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:03:31 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:33.485698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11699f0-75af-4194-9451-21cf589d3db4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:33.486314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11699f0-75af-4194-9451-21cf589d3db4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:33.486314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11699f0-75af-4194-9451-21cf589d3db4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:33.487624 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 565/1135] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:33.494014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:33.494815 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:33.494931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:33.521458 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:33.522706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:33.593950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 571/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:33.619644 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11699f0-75af-4194-9451-21cf589d3db4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:33.733699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11699f0-75af-4194-9451-21cf589d3db4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:33.768565 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:33.769314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:33.769542 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:33.769839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:33.771149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:33.772589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf545f91-6b9f-4777-b3b3-fdf587f022bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:33.774240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 566/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:03:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:33.780415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:33.889812 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4bd9-f040-450a-9830-03d997156662 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:33.927585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:33.936403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:33.938054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:33.938366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:33.938647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:33.939368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:33.940841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5d029-d5c8-4ce1-901d-59afe86bc961 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:33.970976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 572/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:03:33 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:36.021173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6dd5a-a757-4d88-8097-723bf314a346 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.022000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6dd5a-a757-4d88-8097-723bf314a346 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.022000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6dd5a-a757-4d88-8097-723bf314a346 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.024290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 567/1139] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:36.029597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.030021 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.030235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.048976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:36.050194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:36.119668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 573/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:36.143620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6dd5a-a757-4d88-8097-723bf314a346 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:36.213786 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:36.257181 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6dd5a-a757-4d88-8097-723bf314a346 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:36.292105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:36.292893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.293176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.293443 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.304293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:36.312248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:36.313462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:36.314498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 568/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:36.319621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:36.419797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1120f-859d-4fa4-9a69-dfb34f235d3e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:36.436696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:36.463421 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:36.464100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.464387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.464666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.465427 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:36.465741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:36.467169 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:36.475824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 574/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:36.482435 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:36.594082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdadf6-04c8-4e9f-9801-0307df9c6ab5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:36.624107 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:36.638059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:36.638930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.639213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.639488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] PATH_INFO: `/v3/users/336c196790034be48a14de6b262e9e0e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.653173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] RBAC: Authorizing `identity:get_user(user_id=336c196790034be48a14de6b262e9e0e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:36.654677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:36.656313 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 569/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:36 2022] GET /identity/v3/users/336c196790034be48a14de6b262e9e0e => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:36.662372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:36.771446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7667c2-3bf4-42fe-b48a-972ee10e9bad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:36.810054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:36.810732 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:36.811022 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:36.811294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:36.862704 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:36.886078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:36.887572 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:36.987563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 575/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:36.994342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:37.109503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d649b9-6fd2-4381-b29b-f3ce85f2c01c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:37.144905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:37.145754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:37.146068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:37.146340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] PATH_INFO: `/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:37.147645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] RBAC: Authorizing `identity:get_project(project_id=48ac88f46a5047e1968b2f8d9f02dac4)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:37.149082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361697c-f34e-4582-9c47-e2f55415ab50 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:37.150793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 570/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:36 2022] GET /identity/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:37.160540 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:37.249942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:37.276228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b4e16-cff9-4f5a-987c-3b5ed4cb4724 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:37.314557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:37.315207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:37.315493 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:37.315767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:37.316724 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=48ac88f46a5047e1968b2f8d9f02dac4, user.id=336c196790034be48a14de6b262e9e0e) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:37.317041 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:37.318533 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5020-a4e7-49eb-a17d-9cab10a66713 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:37.323978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 576/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:37 2022] GET /identity/v3/role_assignments?user.id=336c196790034be48a14de6b262e9e0e&scope.project.id=48ac88f46a5047e1968b2f8d9f02dac4&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:39.286911 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f13a-5598-4f16-a7d1-f257302d7c3b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:39.287488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f13a-5598-4f16-a7d1-f257302d7c3b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:39.287488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f13a-5598-4f16-a7d1-f257302d7c3b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:39.288852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 571/1147] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:39.295236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:39.295943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:39.296082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:39.316344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:39.317578 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:39.387204 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 577/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:39.412424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f13a-5598-4f16-a7d1-f257302d7c3b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:39.469338 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:39.523768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f13a-5598-4f16-a7d1-f257302d7c3b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:39.561384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:39.562138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:39.562425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:39.562701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:39.574622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:39.582368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:39.583406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:39.584270 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 572/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:39.592374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:39.666870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:39.707771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd873-3162-4f3f-a760-92f31c1eb3bc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:39.742947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:39.743606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:39.743889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:39.744164 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:39.744921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:39.745324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:39.746737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:39.754921 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 578/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:39.761726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:39.873133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013fa39-8282-4153-b0ac-3a4e0485344d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:39.881915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:39.909248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:39.910211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:39.910492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:39.910766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] PATH_INFO: `/v3/users/336c196790034be48a14de6b262e9e0e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:39.912014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] RBAC: Authorizing `identity:get_user(user_id=336c196790034be48a14de6b262e9e0e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:39.913447 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:39.915122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 573/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:39 2022] GET /identity/v3/users/336c196790034be48a14de6b262e9e0e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:39.921451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:40.026256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088e7f-c832-4d0d-a1d3-cc343756f562 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:40.060652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:40.061495 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:40.061777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:40.062070 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] PATH_INFO: `/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:40.063285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] RBAC: Authorizing `identity:get_project(project_id=48ac88f46a5047e1968b2f8d9f02dac4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:40.064730 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b080b-cfef-4a4a-a9b1-74492ccd3834 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:40.066468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 579/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:39 2022] GET /identity/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:40.072921 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:40.183728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69a93-1c09-4f98-82d5-f704772540ed None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:40.221523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:40.222454 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:40.222735 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:40.223006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] PATH_INFO: `/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4/users/336c196790034be48a14de6b262e9e0e/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:40.225002 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48ac88f46a5047e1968b2f8d9f02dac4, user_id=336c196790034be48a14de6b262e9e0e, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:40.226471 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f8d9-a70a-432c-8c71-7038f138c1b5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:40.243020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 574/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:03:40 2022] PUT /identity/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4/users/336c196790034be48a14de6b262e9e0e/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:03:42.227359 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733434-e79e-453a-9b47-3508af829b26 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.227914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733434-e79e-453a-9b47-3508af829b26 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.227914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733434-e79e-453a-9b47-3508af829b26 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:42.229306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 580/1154] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:42.235653 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.236473 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.236631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:42.256381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:42.257591 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:42.289808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:42.335193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 575/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:42.363832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3733434-e79e-453a-9b47-3508af829b26 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:42.367273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:42.470150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3733434-e79e-453a-9b47-3508af829b26 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:42.504949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:42.505699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.505978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.506276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:42.518686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:42.526333 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:42.527403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:42.528398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 581/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:42.534458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:42.647462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e75f9a-d393-4acd-9484-13a4ee2d19f9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:42.682295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:42.683283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.683558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.683829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:42.684570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:42.684870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:42.686264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:42.694336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 576/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:42.700307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:42.762901 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:42.810398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a04621-1a25-457d-b336-bf20135b267e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:42.843851 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:42.844739 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.845021 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.845292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] PATH_INFO: `/v3/users/336c196790034be48a14de6b262e9e0e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:42.846652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] RBAC: Authorizing `identity:get_user(user_id=336c196790034be48a14de6b262e9e0e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:42.848105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:42.849861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 582/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:42 2022] GET /identity/v3/users/336c196790034be48a14de6b262e9e0e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:42.856021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:42.885273 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:42.957389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aba517-583f-4074-92d1-496222f14ecd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:42.992315 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:42.992954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:42.993235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:42.993509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:43.062132 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:43.063539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:43.090517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:43.171834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 577/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:43.178357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:43.277310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471dad1-4a0b-43e2-a92c-fa50a29f69cc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:43.308549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:43.317696 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:43.318537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:43.318823 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:43.319102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] PATH_INFO: `/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:43.320349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] RBAC: Authorizing `identity:get_project(project_id=48ac88f46a5047e1968b2f8d9f02dac4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:43.321805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27be04-ef63-47bd-a5d4-34304418ae5e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:43.323588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 583/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:43 2022] GET /identity/v3/projects/48ac88f46a5047e1968b2f8d9f02dac4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:43.330276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:43.442059 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b94b1-f8b9-4fd7-8aa3-3060cd036a7e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:43.468862 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:43.477477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:43.478135 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:43.478419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:43.478681 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:43.479509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=48ac88f46a5047e1968b2f8d9f02dac4, user.id=336c196790034be48a14de6b262e9e0e) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:43.479814 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:43.481232 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ab2f5-d39f-4501-b7bc-281e6869dd0b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:43.487030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 578/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:43 2022] GET /identity/v3/role_assignments?user.id=336c196790034be48a14de6b262e9e0e&scope.project.id=48ac88f46a5047e1968b2f8d9f02dac4&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:45.477151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985b8e-4e0f-4f0e-8302-e18ad9d4bbe2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:45.478087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985b8e-4e0f-4f0e-8302-e18ad9d4bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:45.478087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985b8e-4e0f-4f0e-8302-e18ad9d4bbe2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:45.480355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 584/1162] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:45.485734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:45.486193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:45.486284 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:45.504817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:45.506066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:45.582953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 579/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:45.605968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc985b8e-4e0f-4f0e-8302-e18ad9d4bbe2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:45.721533 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc985b8e-4e0f-4f0e-8302-e18ad9d4bbe2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:45.761857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:45.762462 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:45.762737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:45.763016 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:45.829069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:45.833150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:45.835827 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:45.940300 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 585/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:45.949428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:46.055125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac703e-ec00-4e7f-a707-f86e0301e746 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:46.078088 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:46.091242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:46.092045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:46.092332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:46.092606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:46.100155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:46.101605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b36f196a-ca82-42ae-8a38-30e643d01833 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:46.116507 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:46.117685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:03:46.118606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 580/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:03:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:46.123913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:46.232451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:46.236738 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3edb5-9824-4668-bfad-0a00ccc55d60 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:46.272212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:46.272869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:46.273155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:46.273434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:46.274191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:46.274501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:46.275872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60174f-c1bc-44a3-8868-5d2d7a3f92f4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:46.283155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 586/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 11 20:03:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:48.271663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126815-460f-49ad-b612-400028cf8d4f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:48.272568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126815-460f-49ad-b612-400028cf8d4f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:48.272568 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126815-460f-49ad-b612-400028cf8d4f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:48.274828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 581/1167] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:48.280996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6317-83c2-4aca-b60f-3a63d8f60ec6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:48.281520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6317-83c2-4aca-b60f-3a63d8f60ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:48.281623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6317-83c2-4aca-b60f-3a63d8f60ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:48.306922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dbdc6317-83c2-4aca-b60f-3a63d8f60ec6 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:48.308464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dbdc6317-83c2-4aca-b60f-3a63d8f60ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:48.385392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 587/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:48.408679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126815-460f-49ad-b612-400028cf8d4f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:48.518473 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126815-460f-49ad-b612-400028cf8d4f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:48.554415 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:48.554997 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:48.555277 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:48.555549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:48.556293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:48.558006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9568f-7ce9-4a0e-968d-0367ae38b357 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:48.576026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 582/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Jul 11 20:03:48 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:50.600399 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761896c-c545-4c2e-85e7-79c73355911c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:50.600975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761896c-c545-4c2e-85e7-79c73355911c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:50.600975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761896c-c545-4c2e-85e7-79c73355911c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:50.603121 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 588/1170] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:50.611068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:50.611535 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:50.611636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:50.629282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:50.630580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:50.670335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:50.711566 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 583/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:50.735471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761896c-c545-4c2e-85e7-79c73355911c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:50.835350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:50.846337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761896c-c545-4c2e-85e7-79c73355911c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:50.881206 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:50.882017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:50.882334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:50.882611 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] PATH_INFO: `/v3/domains/a0c6e9e8aae2441e87a6129f023c3ede` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:50.893543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=a0c6e9e8aae2441e87a6129f023c3ede)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:50.895035 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010b4d-7216-4f00-81f0-56b91a381beb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:50.896771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 589/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 11 20:03:50 2022] GET /identity/v3/domains/a0c6e9e8aae2441e87a6129f023c3ede => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:50.902870 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:51.029600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536afd3-b83e-4f71-b633-e33a3cd1f5c0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:51.067872 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:51.068523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:51.068804 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:51.069074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:51.069783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:51.071255 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf780-09bb-4973-8929-e081cf86aa37 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:51.098296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 584/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:03:50 2022] POST /identity/v3/projects => generated 361 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:53.125825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4cb-b12e-43b0-b533-bbd1642185a0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:53.126410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4cb-b12e-43b0-b533-bbd1642185a0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:53.126410 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4cb-b12e-43b0-b533-bbd1642185a0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:53.127698 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 590/1174] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:53.134091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:53.134778 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:53.134935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:53.163018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:53.164209 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:53.182418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:53.233830 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 585/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:53.259187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea4cb-b12e-43b0-b533-bbd1642185a0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:53.388564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea4cb-b12e-43b0-b533-bbd1642185a0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:53.422387 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:53.423239 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:53.423516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:53.423788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] PATH_INFO: `/v3/domains/a0c6e9e8aae2441e87a6129f023c3ede` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:53.425084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a0c6e9e8aae2441e87a6129f023c3ede)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:53.426550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1120-64e8-425f-8631-20f65d6e47b6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:53.428194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 591/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 11 20:03:53 2022] GET /identity/v3/domains/a0c6e9e8aae2441e87a6129f023c3ede => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:53.434342 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:53.537541 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78967f9-5086-4596-8369-b7f480e04274 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:53.575384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:53.576042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:53.576326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:53.576599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:53.577322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:53.578799 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2456ea7-aad9-4886-bf46-14bd6885a181 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:53.601464 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 586/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:03:53 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:03:55.668268 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2025a-4e46-4ec5-a659-84e4036125bc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:55.668836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2025a-4e46-4ec5-a659-84e4036125bc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:55.668836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2025a-4e46-4ec5-a659-84e4036125bc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:55.670974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 592/1178] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:55.678783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:55.679244 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:55.679345 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:55.698014 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:55.699672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:55.703594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:55.773229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 587/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:03:55.796546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2025a-4e46-4ec5-a659-84e4036125bc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:55.827197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:55.910285 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2025a-4e46-4ec5-a659-84e4036125bc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:55.947216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:55.947951 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:55.948231 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:55.948497 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:55.960302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:55.967870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:55.969019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:55.970392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 593/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:55.975407 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:56.090053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f554d-f2cd-4a62-bee4-464ad71d348b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:56.124907 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:56.125563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:56.125842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:56.126144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:56.126887 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:56.127193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:56.128560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:56.136627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 588/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:56.142314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:56.223549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:56.251956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d10a4-c1bf-4233-b144-545b1228a3f5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:56.287787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:56.288668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:56.288953 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:56.289232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] PATH_INFO: `/v3/users/58efdb78bf75430eb0396287d56df8d8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:56.302878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] RBAC: Authorizing `identity:get_user(user_id=58efdb78bf75430eb0396287d56df8d8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:56.304334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:56.305974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 594/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:56 2022] GET /identity/v3/users/58efdb78bf75430eb0396287d56df8d8 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:56.312109 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:56.315110 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:56.429900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8ab0-9939-4eae-a858-821b57a81f3a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:56.466335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:56.466979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:56.467258 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:56.467529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:56.538187 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:56.539578 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:56.541639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:56.650369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 589/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:03:56.657038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:56.769648 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c06bf-1349-43ed-aa47-3692c0efe405 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:56.805241 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:56.806081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:56.806374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:56.806649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] PATH_INFO: `/v3/projects/0c330e5baeba4200ac17b74cec644e04` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:56.808295 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=0c330e5baeba4200ac17b74cec644e04)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:56.809760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955101f-c2d6-4360-ad57-ff39f4c03dd8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:56.811492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 595/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:56 2022] GET /identity/v3/projects/0c330e5baeba4200ac17b74cec644e04 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:56.818755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:56.929045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e28a-390f-4d26-a3c2-939cd9b77fbd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:56.930684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:56.966348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:56.967018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:56.967303 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:56.967573 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:56.968416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=0c330e5baeba4200ac17b74cec644e04, user.id=58efdb78bf75430eb0396287d56df8d8) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:56.968733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:56.970233 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d59f9f-6724-4ef3-b185-0493db6d6f25 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:56.975973 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 590/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:03:56 2022] GET /identity/v3/role_assignments?user.id=58efdb78bf75430eb0396287d56df8d8&scope.project.id=0c330e5baeba4200ac17b74cec644e04&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:58.948976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603be8-7a81-492d-8567-5166aee0c120 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:58.949750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603be8-7a81-492d-8567-5166aee0c120 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:58.949915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603be8-7a81-492d-8567-5166aee0c120 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:58.952158 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 596/1186] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:03:58.958777 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:58.959494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:58.959586 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:58.987466 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:03:58.989513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:03:59.060002 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 591/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:03:59.086276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a603be8-7a81-492d-8567-5166aee0c120 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:59.097522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:59.197984 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a603be8-7a81-492d-8567-5166aee0c120 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:59.235217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:59.236407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:59.236779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:59.237165 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:59.255302 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:03:59.262982 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:03:59.263980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:03:59.264945 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:03:59.266191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 597/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:03:59.271302 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:59.374023 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:59.382423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ef44-f148-401e-91e1-0a1e77391ea6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:59.418438 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:59.419097 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:59.419378 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:59.419654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:59.420396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:03:59.420709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:59.422100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:59.430364 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 592/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:59.436934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:59.514402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:59.551801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae5634-b1ef-4865-b720-9891505857fa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:59.586939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:59.587800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:59.588086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:59.588361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] PATH_INFO: `/v3/users/58efdb78bf75430eb0396287d56df8d8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:59.589606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] RBAC: Authorizing `identity:get_user(user_id=58efdb78bf75430eb0396287d56df8d8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:59.591076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:59.592718 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 598/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:03:59 2022] GET /identity/v3/users/58efdb78bf75430eb0396287d56df8d8 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:03:59.599497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:59.720645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145afc-1b1b-4e3a-8504-829316cee7f5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:59.756028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:59.756900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:59.757181 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:59.757457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] PATH_INFO: `/v3/projects/0c330e5baeba4200ac17b74cec644e04` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:59.758720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] RBAC: Authorizing `identity:get_project(project_id=0c330e5baeba4200ac17b74cec644e04)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:59.760177 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1a8f-3fce-499b-b7ee-de1fd935e11b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:59.761877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 593/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:03:59 2022] GET /identity/v3/projects/0c330e5baeba4200ac17b74cec644e04 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:03:59.770823 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:03:59.873829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1d800-7e6b-431e-a301-6c52d022a38d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:03:59.908385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:03:59.909273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:03:59.909550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:03:59.909818 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] PATH_INFO: `/v3/projects/0c330e5baeba4200ac17b74cec644e04/users/58efdb78bf75430eb0396287d56df8d8/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:03:59.911974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c330e5baeba4200ac17b74cec644e04, user_id=58efdb78bf75430eb0396287d56df8d8, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:03:59.913422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcb92a-94ce-4c84-956f-2f5c66fba1e6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:03:59.915852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:03:59.933130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 599/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:03:59 2022] PUT /identity/v3/projects/0c330e5baeba4200ac17b74cec644e04/users/58efdb78bf75430eb0396287d56df8d8/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:04:01.886076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1151-6450-4828-a11a-a0302b325f1d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:01.886558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1151-6450-4828-a11a-a0302b325f1d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:01.886675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1151-6450-4828-a11a-a0302b325f1d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:01.887968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 594/1193] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:04:01.894412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:01.895124 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:01.895381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:01.924191 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:04:01.926137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:04:01.994985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 600/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:04:02.019294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1151-6450-4828-a11a-a0302b325f1d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:02.052008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:02.129456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1151-6450-4828-a11a-a0302b325f1d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:02.177910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:02.178717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:02.179000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:02.179271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:02.190164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:04:02.197711 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:04:02.198817 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:04:02.200045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 595/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:04:02.207446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:02.321542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22415a-db9f-45de-ac72-6a0558deade2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:02.346176 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:02.358814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:02.359514 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:02.359809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:02.360118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:02.360931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:04:02.361244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:02.362759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:02.371481 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 601/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:04:02.377933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:02.472398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:02.489084 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff077-7994-4f0a-bd1f-036a8ad292fa None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:02.526053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:02.526941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:02.527226 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:02.527491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] PATH_INFO: `/v3/users/58efdb78bf75430eb0396287d56df8d8` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:02.528700 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] RBAC: Authorizing `identity:get_user(user_id=58efdb78bf75430eb0396287d56df8d8)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:02.530172 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:02.531757 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 596/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 11 20:04:02 2022] GET /identity/v3/users/58efdb78bf75430eb0396287d56df8d8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:04:02.537832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:02.639328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0eca2-142f-46f5-b0d2-a4b1d02a4609 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:02.676135 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:02.676826 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:02.677103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:02.677374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:02.731874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:02.749255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:02.750752 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:02.856225 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 602/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:04:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:04:02.865925 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:02.976937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417d1a-7d4f-43a0-973d-1acebfda8489 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:03.019168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:03.019959 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:03.020240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:03.020513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] PATH_INFO: `/v3/projects/0c330e5baeba4200ac17b74cec644e04` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:03.021734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] RBAC: Authorizing `identity:get_project(project_id=0c330e5baeba4200ac17b74cec644e04)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:03.023215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c00bb8-5c56-4622-a9fe-fc730acb4444 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:03.024913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 597/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 11 20:04:02 2022] GET /identity/v3/projects/0c330e5baeba4200ac17b74cec644e04 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:04:03.031235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:03.122726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:03.138456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5cc46-e617-4873-9637-c6001c0d5a70 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:03.173513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:03.174195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:03.174475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:03.174751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:03.175576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=0c330e5baeba4200ac17b74cec644e04, user.id=58efdb78bf75430eb0396287d56df8d8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:04:03.175886 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:03.177435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39b2a9-5818-464b-94d3-4eb2a50e99b6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:03.183599 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 603/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:04:03 2022] GET /identity/v3/role_assignments?user.id=58efdb78bf75430eb0396287d56df8d8&scope.project.id=0c330e5baeba4200ac17b74cec644e04&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:04:13.013520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:13.180828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:58.091929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6616bc6-a2a9-4b49-af33-289bfe6d0074 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:58.092531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6616bc6-a2a9-4b49-af33-289bfe6d0074 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:58.092531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6616bc6-a2a9-4b49-af33-289bfe6d0074 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:58.093770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 598/1201] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:04:58.101431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:58.101431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:58.101431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:58.121610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:04:58.122925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:04:58.207326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 604/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:04:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:04:58.234663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6616bc6-a2a9-4b49-af33-289bfe6d0074 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:58.357421 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6616bc6-a2a9-4b49-af33-289bfe6d0074 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:58.402308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:58.403131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:58.403414 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:58.403713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:58.418025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:58.419517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:04:58.441457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:04:58.447457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:04:58.449557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:04:58.449557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:04:58.449557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:04:58.449557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:04:58.449557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 599/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:04:58.449874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:58.576316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713a228-8ec3-4a5b-a301-e160ca9e16ab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:58.612186 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:58.619032 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:58.619717 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:58.620005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:58.620286 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:58.621057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:04:58.621393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:58.622860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bce76-32a2-41f6-b5a7-a40b8a3960f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:58.643056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 605/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:04:58.643337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:04:58.709882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:04:58.767291 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d279e0-88ed-4769-bda3-68dec2e743d1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:04:58.808606 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:04:58.809736 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:04:58.810238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:04:58.810691 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:04:58.815203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:04:58.816779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb62db-3c87-47f8-8c6c-810d0dc2f8a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:04:58.846554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 600/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 11 20:04:58 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:05:01.240513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441139ac-49f1-4584-808c-6cd690b4762b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:01.241144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441139ac-49f1-4584-808c-6cd690b4762b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:01.241144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441139ac-49f1-4584-808c-6cd690b4762b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:01.242559 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 606/1206] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:01.248705 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:01.249167 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:01.249355 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:01.267832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:01.269194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:01.346519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 601/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:01.373655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441139ac-49f1-4584-808c-6cd690b4762b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:01.496123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441139ac-49f1-4584-808c-6cd690b4762b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:01.534809 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:01.535904 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:01.536350 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:01.536888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:01.552294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:01.561515 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:01.562670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:01.563629 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 607/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:01.569186 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:01.618248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:01.685242 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4867d-13a2-4644-a6f8-e239054be899 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:01.729439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:01.730178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:01.730457 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:01.730779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:01.731702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:01.732034 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:01.733539 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:01.748488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 602/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:01.753006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:01.815134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:01.877633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8cd5-6492-4771-9012-2d4e33c4b8fa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:01.919500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:01.920413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:01.920721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:01.921003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:01.935007 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:01.936561 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:01.958122 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:01.959331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:01.960419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:01.960419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:01.960419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:01.960419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:01.964663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 608/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:01.967016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:02.096077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:02.100450 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc867-56c6-4a66-8c9b-7788c8fab180 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:02.141651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:02.142412 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:02.142729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:02.143018 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:02.143934 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:02.144366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:02.145834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:02.163902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 603/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:02.170816 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:02.288407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6ad36-4bc5-4ae0-8121-17fdd67ea51b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:02.290136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:02.330362 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:02.331215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:02.331494 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:02.331756 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:02.340547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:02.342058 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:02.357346 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:02.358432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:02.359397 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 609/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:02.364888 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:02.479438 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2340a-e063-4be8-9161-35a62031f18f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:02.521200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:02.521849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:02.522166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:02.522521 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:02.523356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:02.523671 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:02.525124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:02.545106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 604/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:02.550919 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:02.679038 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf01be-8e2f-4def-8980-8a32d23312ef None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:02.720403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:02.721140 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:02.722224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:02.722224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:02.754020 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:02.803137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:02.804811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:02.927426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 610/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:05:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:05:02.930529 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:02.954020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:03.055092 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ae9f-6742-400c-bda6-1cea0bf3a017 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:03.093560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:03.094602 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:03.094975 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:03.095312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:03.107781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:03.109301 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:03.130282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:03.131660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:03.132942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:03.132942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:03.132942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:03.132942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:03.134761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 605/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:03.140633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:03.207349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:03.252708 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777038-e489-4343-b908-0a1e38ddf4d6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:03.289339 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:03.290199 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:03.290581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:03.290956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:03.291802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:03.292211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:03.294973 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:03.307482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 611/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:03.313424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:03.387594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:03.427703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb18f-a9c3-4d6f-a1e2-5efc916ed2bc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:03.467953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:03.468893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:03.469196 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:03.469501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:03.479476 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:03.481326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:03.499148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:03.500431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:03.506734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 606/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:03.508586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:03.627102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a871d-7b99-4ce6-9394-0aff856c4ee6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:03.653156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:03.668442 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:03.669207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:03.669567 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:03.669913 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:03.670810 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:03.671198 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:03.672820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f757-0742-4089-9f65-d8a960d57ada None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:03.688620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 612/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:03.694865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:03.822843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc342630-51d0-44f2-b686-a13f2a2e5866 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:03.860908 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:03.867648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:03.868408 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:03.868739 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:03.869048 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:03.869947 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=edf638c8b45e4a3f965d57837e222f5d) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:03.870293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:03.871909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a4cb9-465e-4ab4-8900-b108e4d5a92a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:03.882077 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 607/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:05:03 2022] GET /identity/v3/role_assignments?user.id=edf638c8b45e4a3f965d57837e222f5d&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:06.089174 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54694-dda5-43d3-a28e-3bc33b689200 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.089714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54694-dda5-43d3-a28e-3bc33b689200 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.089714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54694-dda5-43d3-a28e-3bc33b689200 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.091323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 613/1220] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:06.097239 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.097716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.097833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.117660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:06.118964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:06.193654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 608/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:06.216467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54694-dda5-43d3-a28e-3bc33b689200 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:06.329069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54694-dda5-43d3-a28e-3bc33b689200 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:06.366996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:06.367779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.368082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.368358 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.379872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:06.389381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:06.390597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:06.391652 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:06.396418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 614/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:06.397559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:06.504354 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c8d7-d040-4cbc-bc37-734a35b6dc3b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:06.529458 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:06.542998 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:06.543879 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.544241 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.544688 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.545701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:06.546016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:06.547454 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:06.557083 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 609/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:06.565304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:06.617102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:06.675868 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcef6-033a-4156-a224-2cda1ee827bb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:06.710622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:06.711430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.711710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.711993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.723172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:06.724750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:06.742080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:06.742986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:06.749048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:06.749048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:06.749048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:06.749048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:06.749048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 615/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:06.749327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:06.862186 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaba83-ebcd-4b02-9a08-1497978af8e9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:06.900546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:06.901314 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:06.901599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:06.901873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:06.902712 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:06.903154 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:06.904891 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:06.919126 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 610/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:06.926351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.039801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:07.050356 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b0ad-1066-4f0a-9a6a-91d063823fda None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:07.097275 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:07.098326 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:07.098612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:07.098956 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:07.108549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:07.110049 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:07.124891 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:07.126433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:07.127392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 616/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:07.132622 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.181907 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:07.240651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5bb1-f519-4a4e-ad82-c82e80977fd2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:07.290020 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:07.290733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:07.291001 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:07.291271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:07.292107 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:07.292410 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:07.293842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:07.317776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 611/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:07.319069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.422904 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66b38-4cb7-48d2-83d6-08f94e18fafc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:07.463282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:07.464004 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:07.464314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:07.464576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:07.476483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:07.477972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:07.495856 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:07.497054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:07.498123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:07.498123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:07.498123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:07.498123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:07.498123 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 617/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:05:07.503231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.611392 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c9f4e-8ed8-4e7e-a108-6556d1a9157c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:07.613923 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:07.654983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:07.655722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:07.656045 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:07.656348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:07.657171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:07.657503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:07.659036 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:07.672863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 612/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:07.678612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.689516 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:07.792424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ed34-ec07-4b0c-9587-7c50cfca8cec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:07.835263 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:07.836090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:07.836725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:07.836870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:07.844072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:07.845639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:07.861034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:07.862215 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:07.863235 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 618/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:07.868795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:07.978808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051343-ae96-40a6-91e6-2e74998f34e6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:08.017707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:08.018545 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:08.018861 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:08.019210 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:08.020016 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:08.020333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:08.021809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b81295-d83a-4e83-b678-df2d2bfaa79a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:08.034026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 613/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:08.040592 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:08.113028 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:08.156101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc863-4d56-4e8a-a943-4a438f6fbabe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:08.195077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:08.196210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:08.196511 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:08.196867 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/edf638c8b45e4a3f965d57837e222f5d/roles/216d37d7e00f42bdb1a10d8526e030c5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:08.212720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=edf638c8b45e4a3f965d57837e222f5d, role_id=216d37d7e00f42bdb1a10d8526e030c5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:08.214377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9e7c4-5200-48f4-ac14-412d049dc338 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:08.229323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 619/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:05:08 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/edf638c8b45e4a3f965d57837e222f5d/roles/216d37d7e00f42bdb1a10d8526e030c5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:05:10.237340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80a34a-738e-4aa7-987b-fc48eb712913 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:10.237889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80a34a-738e-4aa7-987b-fc48eb712913 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:10.237889 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80a34a-738e-4aa7-987b-fc48eb712913 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:10.239267 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 614/1233] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:10.244532 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:10.244934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:10.245119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:10.261623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:10.262857 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:10.330312 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 620/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:10.356051 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80a34a-738e-4aa7-987b-fc48eb712913 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:10.388764 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:10.471900 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80a34a-738e-4aa7-987b-fc48eb712913 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:10.508406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:10.509131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:10.509404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:10.509668 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:10.521195 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:10.528892 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:10.530164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:10.531246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 615/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 11 20:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:10.536967 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:10.594060 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:10.654707 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc879f8-fcd5-4002-b8df-3e566b24a27d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:10.690706 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:10.691382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:10.691669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:10.691958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:10.692800 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:10.693116 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:10.694535 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:10.703647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 621/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 11 20:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:10.709858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:10.803213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:10.820574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe241-9c2a-4603-aae5-30558fa6aa0a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:10.858672 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:10.859479 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:10.859756 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:10.860082 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:10.871000 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:10.872485 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:10.890050 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:10.891131 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:10.892176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:10.892176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:10.892176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:10.892176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:10.892176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 616/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:10.897248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:11.003155 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5f15-64ad-4671-a146-eee320ae1293 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:11.012645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:11.038405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:11.039074 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:11.039360 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:11.039634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:11.040353 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:11.040695 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:11.042154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:11.059547 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 622/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:11.060615 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:11.174360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174dde3-04fe-440b-b89e-d3597be7088e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:11.209639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:11.210560 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:11.210911 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:11.211229 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:11.214557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:11.220679 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:11.222375 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:11.238605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:11.240056 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:11.241007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 617/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:05:11.246873 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:11.361269 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4148f6-7407-4b87-a5b1-ec76f270231e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:11.397145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:11.398005 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:11.398422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:11.398791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:11.399831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:11.400263 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:11.402140 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:11.421785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 623/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:11.428070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:11.538665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c97734-70cf-4718-bde5-881396720e68 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:11.573882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:11.574600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:11.574894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:11.575163 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:11.639222 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:11.646839 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:11.648395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:11.764690 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 618/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:05:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:05:11.771464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:11.807157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:11.888111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4a81f-d6d1-411f-86a7-b60b813a6aff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:11.924379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:11.925088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:11.925374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:11.925650 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:11.937280 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:11.938860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:11.956443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:11.957524 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:11.958710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:11.958710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:11.958710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:11.958710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:11.962185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 624/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:11.963810 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:12.069461 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:12.076445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822d1c-07be-4126-b970-dbc0c9e3d9f4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:12.112877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:12.113647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:12.113932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:12.114238 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:12.115058 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:12.115374 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:12.116752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:12.128253 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 619/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:12.134293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:12.215197 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:12.241179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351d43d-e097-4a93-8475-73ea47642d17 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:12.278830 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:12.279667 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:12.279947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:12.280218 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:12.287334 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:12.288801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:12.302980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:12.304051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:12.304968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 625/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:12.310557 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:12.417673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ade2d-58f2-4cbf-9ed3-e384cf060029 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:12.454755 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:12.455441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:12.455854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:12.456128 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:12.457372 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:12.457694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:12.459601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e50486-d670-41b2-a48a-caf082becf9a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:12.474214 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 620/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:12.480234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:12.588563 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54175-2998-430d-b3e9-884eb6f355a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:12.629987 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:12.630731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:12.631031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:12.631313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:12.632220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] RBAC: Adding query filter params (role.id=216d37d7e00f42bdb1a10d8526e030c5, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=edf638c8b45e4a3f965d57837e222f5d) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:12.632537 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:12.634144 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c9be-1744-462a-a4f1-a60c83ecfa7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:12.640903 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 626/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:05:12 2022] GET /identity/v3/role_assignments?user.id=edf638c8b45e4a3f965d57837e222f5d&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=216d37d7e00f42bdb1a10d8526e030c5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:14.791136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6390a0-9ee9-42fd-b905-04d364fb1886 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:14.791812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6390a0-9ee9-42fd-b905-04d364fb1886 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:14.791812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6390a0-9ee9-42fd-b905-04d364fb1886 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:14.793037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 621/1247] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:14.798870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:14.799412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:14.799502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:14.805310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:14.820455 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:14.821766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:14.901443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 627/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:14.925462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6390a0-9ee9-42fd-b905-04d364fb1886 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:14.947699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:15.039349 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6390a0-9ee9-42fd-b905-04d364fb1886 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:15.081380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:15.082261 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:15.082563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:15.082841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:15.097071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:15.106495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:15.107849 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:15.108880 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:15.113674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 622/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:15.114776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:15.228420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825553b-020a-4865-a882-7a6db7c1af3c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:15.260330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:15.266367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:15.267045 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:15.267328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:15.267604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:15.268429 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:15.268768 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:15.270258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:15.279559 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 628/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:15.285647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:15.374340 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:15.402060 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f648-22cb-4562-8dae-a8f05d30144a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:15.440513 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:15.441411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:15.441635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:15.441912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:15.453005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:15.454492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:15.471962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:15.473235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:15.474281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:15.474281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:15.474281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:15.474281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:15.474281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 623/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:15.479292 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:15.592811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ca08-d764-4065-bacb-c651629eb0e8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:15.634799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:15.635390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:15.635677 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:15.635997 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:15.636729 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:15.637063 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:15.638725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:15.651984 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 629/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:15.658333 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:15.778853 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc7c0-3631-4087-be08-a519877471bb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:15.814091 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:15.824453 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:15.825283 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:15.825564 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:15.825847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:15.835004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:15.836462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:15.853440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:15.855133 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:15.857042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 624/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:15.861254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:15.935624 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:15.987772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2bfad-0054-4316-a49a-d557b995dafb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:16.023243 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:16.023958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:16.024240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:16.024520 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:16.025351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:16.025677 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:16.027139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:16.050082 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 630/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:16.051518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:16.168439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7537-5dd4-481c-a68b-fe8b923023ac None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:16.206418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:16.207003 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:16.207285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:16.207558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:16.268416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:16.282556 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:16.284030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:16.385621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 625/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:05:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:05:16.391527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:16.498286 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed5ca9-4861-4e2c-8125-12ed7d91119a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:16.511798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:16.533313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:16.534293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:16.534597 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:16.534911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:16.545841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:16.547529 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:16.568372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:16.569604 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:16.570564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:16.570564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:16.570564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:16.570564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:16.570564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 631/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:16.575960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:16.676955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:16.689574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fed82-2062-4d91-b5a6-3ae2d295e4ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:16.725292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:16.725963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:16.726268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:16.726548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:16.727279 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:16.727588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:16.728972 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:16.741285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 626/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:16.747185 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:16.856464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d460613-a165-4b0b-9cb6-bd0fb763f427 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:16.893012 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:16.893915 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:16.894256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:16.894609 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:16.901828 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:16.903341 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:16.917895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:16.918883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:16.919776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 632/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:16.928363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:17.035641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3d545-6394-455b-a343-57f4e4a7beea None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:17.070909 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:17.071581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:17.071864 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:17.072136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:17.072936 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:17.073233 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:17.074729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427658d-d1b3-4f91-b565-c644d58050be None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:17.092631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 627/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:17.093749 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:17.122819 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:17.200838 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f178dba-85ec-404c-890c-6ab0ba7a140c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:17.239354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:17.240070 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:17.240386 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:17.240617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:17.241465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=edf638c8b45e4a3f965d57837e222f5d) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:17.241808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:17.243256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa4352-3adc-4501-9fe8-e0d23ab81734 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:17.249006 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 633/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:05:17 2022] GET /identity/v3/role_assignments?user.id=edf638c8b45e4a3f965d57837e222f5d&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:19.287300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902cad-aa2c-4210-a3dd-a7e31cafcd5d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:19.287913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902cad-aa2c-4210-a3dd-a7e31cafcd5d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:19.287913 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902cad-aa2c-4210-a3dd-a7e31cafcd5d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:19.289230 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 628/1261] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:19.295681 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:19.296466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:19.296635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:19.323137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:19.324337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:19.406843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 634/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:19.430022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902cad-aa2c-4210-a3dd-a7e31cafcd5d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:19.442523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:19.546212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902cad-aa2c-4210-a3dd-a7e31cafcd5d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:19.584113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:19.584778 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:19.585054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:19.585327 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:19.595993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:19.605268 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:19.606587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:19.607627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 629/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:19.612806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:19.631640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:19.717004 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be619cf4-be8b-4736-8554-421d9c54cdfe None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:19.755461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:19.756148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:19.756426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:19.756732 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:19.757490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:19.757802 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:19.759492 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:19.769813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 635/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:19.776499 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:19.860795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:19.896467 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e3e7-2fe6-4ecd-9a34-6ee4c9ddfe14 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:19.931674 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:19.932468 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:19.933080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:19.933357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:19.944668 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:19.946151 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:19.963783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:19.964808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:19.965801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:19.965801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:19.965801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:19.965801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:19.965801 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 630/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:19.971211 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.055352 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:20.079040 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664871ae-47e4-4b2b-82b8-7e5da9f751fd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:20.127253 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:20.127461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:20.127947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:20.128445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:20.129431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:20.129767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:20.131293 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:20.144671 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 636/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:20.150589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.257373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf2e9e-7f11-49fd-afac-49051140cf62 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:20.277121 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:20.295309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:20.296103 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:20.296385 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:20.296654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:20.304216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:20.305693 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:20.320183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:20.321263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:20.322697 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 631/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:20.327129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.429057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f072d-2ed6-42c7-a7fd-220b2aa32500 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:20.464590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:20.465244 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:20.465523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:20.465795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:20.466657 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:20.466966 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:20.468383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:20.476977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:20.491466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 637/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:20.497111 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.608551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b270cc-e8cd-4d8d-b2ee-fe2cea411ff9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:20.644168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:20.644978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:20.645252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:20.645524 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:20.656358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:20.657793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:20.674820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:20.675865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:20.676846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:20.676846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:20.676846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:20.676846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:20.676846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 632/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:20.682083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.789804 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b781320-3291-4367-9d3f-df500173a25d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:20.826589 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:20.827409 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:20.827526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:20.827831 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:20.828569 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:20.828883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:20.830288 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:20.842102 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 638/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:20.847986 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:20.895424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:20.968575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3e177-5b90-4f3c-b4e9-bfe801490052 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:21.006528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:21.007335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:21.007618 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:21.007893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:21.015678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:21.017140 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:21.031767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:21.032815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:21.033927 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 633/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:21.039085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:21.097324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:21.141390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300f66-39fa-45da-9fa9-fe8c73f20844 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:21.175791 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:21.176451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:21.176734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:21.177064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:21.177852 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:21.178196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:21.179640 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f7743-a61d-4c12-93d1-701e77113def None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:21.192001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 639/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:21.198999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:21.301852 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:21.316286 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60fa5b-809b-442d-90ed-cc16cda97669 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:21.359846 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:21.360768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:21.361047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:21.361323 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] PATH_INFO: `/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/edf638c8b45e4a3f965d57837e222f5d/roles/0732a4581af94fb4bfbf5c393e17f249` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:21.363549 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d192a54da2a14b518a9c41a7af59f9bd, user_id=edf638c8b45e4a3f965d57837e222f5d, role_id=0732a4581af94fb4bfbf5c393e17f249)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:21.365044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e6c4b-8524-40ec-b77e-29b080a6d9b8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:21.381627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 634/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 11 20:05:21 2022] PUT /identity/v3/projects/d192a54da2a14b518a9c41a7af59f9bd/users/edf638c8b45e4a3f965d57837e222f5d/roles/0732a4581af94fb4bfbf5c393e17f249 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:05:23.375148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d709-5fbc-42c6-811f-bf709a026c8d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:23.375702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d709-5fbc-42c6-811f-bf709a026c8d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:23.375702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d709-5fbc-42c6-811f-bf709a026c8d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:23.377103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 640/1274] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:23.383397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:23.384073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:23.384251 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:23.406414 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:23.407607 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:23.478247 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 635/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:23.506807 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46d709-5fbc-42c6-811f-bf709a026c8d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:23.620889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46d709-5fbc-42c6-811f-bf709a026c8d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:23.638999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:23.656623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:23.657415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:23.657693 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:23.657962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:23.667978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:05:23.675595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:23.676631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:23.677753 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 641/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 11 20:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:23.685304 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:23.767231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:23.790190 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052e6b-1e65-4324-a12e-0c1710293512 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:23.830106 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:23.831101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:23.831474 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:23.831816 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:23.832966 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:23.833399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:23.835592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:23.848979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 636/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 11 20:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:23.854819 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:23.961710 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1870c-7941-470c-bd54-ff2c2e7bec2b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:23.998767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:23.999550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:23.999821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:24.000086 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:24.011761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:24.013207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:24.030914 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:24.031939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:24.033003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:24.033003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:24.033003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:24.033003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:24.033003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 642/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:24.038148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:24.144281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea24f-0783-4b16-a384-feade5d64f27 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:24.188235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:24.188895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:24.189171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:24.189440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:24.190194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:24.190501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:24.191871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:24.203707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 637/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:24.210371 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:24.254855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:24.338881 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7898c5-ff80-4e07-b802-60b4506180b9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:24.374137 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:24.374937 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:24.375216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:24.375779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:24.383172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:24.384637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:05:24.399221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:24.400297 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:24.401430 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 643/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:24.406416 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:24.410537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:24.509893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bac70-61f6-421b-840f-f3c5366d96df None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:24.545660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:24.546356 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:24.546636 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:24.546914 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:24.547752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:24.548064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:24.549492 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:24.571427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 638/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 11 20:05:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:24.577406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:24.671475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:24.682934 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bd5c9-d495-4873-af96-aa731869bb3d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:24.717694 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:24.718366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:24.718637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:24.718911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:24.794388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:24.795822 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:24.889964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:24.900371 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 644/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 11 20:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:05:24.906405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:24.968308 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:25.005813 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11eb5a-d8ca-4bfc-b91c-5222ab9273c1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:25.039318 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:25.040126 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:25.040405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:25.040680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:25.050920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:25.052551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:05:25.070125 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:25.071309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:25.072344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:05:25.072344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:05:25.072344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:05:25.072344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:25.077283 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:25.078827 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 639/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:25.177950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f706-3037-491c-8e29-c50af0f244c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:25.213459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:25.214146 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:25.214426 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:25.214702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:25.215431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:25.215741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:25.217126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:25.228546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 645/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 11 20:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:25.234483 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:25.344495 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f7615-25dd-40e2-91cc-143564f1aecf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:25.358581 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:25.382502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:25.383292 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:25.383570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:25.383844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:25.390792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:25.392234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:05:25.406124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:25.407531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jul 11 20:05:25.408553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 640/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 11 20:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:25.413434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:25.477417 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:25.538742 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6309812-38ad-43d8-bf34-93710e31776a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:25.573777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:25.574702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:25.575027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:25.575284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:25.576168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:25.576538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:25.578340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666a52-931b-4c06-95c9-8b996de6b336 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:25.597628 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 646/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 11 20:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:25.604515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:25.711138 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe6ba0-88f0-438b-a57f-7c3d41d8c5ff None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:25.745398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:25.746067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:25.746353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:25.746621 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:25.747430 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] RBAC: Adding query filter params (role.id=0732a4581af94fb4bfbf5c393e17f249, scope.project.id=d192a54da2a14b518a9c41a7af59f9bd, user.id=edf638c8b45e4a3f965d57837e222f5d) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:25.747760 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:25.749193 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccf67c-8adc-4698-9cdc-e104d9e824df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:25.755212 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 641/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 11 20:05:25 2022] GET /identity/v3/role_assignments?user.id=edf638c8b45e4a3f965d57837e222f5d&scope.project.id=d192a54da2a14b518a9c41a7af59f9bd&role.id=0732a4581af94fb4bfbf5c393e17f249 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:27.793163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba078444-d4d0-402e-91cb-3e19fd7dad58 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:27.793758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba078444-d4d0-402e-91cb-3e19fd7dad58 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:27.793758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba078444-d4d0-402e-91cb-3e19fd7dad58 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:27.795101 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 647/1288] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:27.801517 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:27.802271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:27.802465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:27.826063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:27.827252 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:27.863627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:27.909641 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 642/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:27.932064 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba078444-d4d0-402e-91cb-3e19fd7dad58 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:28.046128 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba078444-d4d0-402e-91cb-3e19fd7dad58 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:28.064523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:28.098870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:28.099762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:28.100067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:28.100403 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:28.101119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:28.102785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:28.116453 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:28.117619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:28.118699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 648/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:05:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:28.124715 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:28.233397 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370b3d-910c-4e71-80e1-5268ee91ef85 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:28.269028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:28.269678 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:28.269953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:28.270256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:28.270987 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:28.271293 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:28.272651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298e63-1b55-440d-a085-60ae1aca50f4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:28.277575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 643/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 11 20:05:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:28.283711 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:28.387405 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bde8f-ce9a-46e7-9d86-9b43d393ba2a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:28.425701 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:28.426378 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:28.426663 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:28.426965 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:28.427666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:28.427976 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:28.429352 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e49c-ec84-46f0-97d8-c0fa30aed44e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:28.434388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 649/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 11 20:05:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:30.420389 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579af48-4d0e-422e-be02-3b370656b499 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:30.421259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579af48-4d0e-422e-be02-3b370656b499 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:30.421259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579af48-4d0e-422e-be02-3b370656b499 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:30.423603 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 644/1293] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:30.430512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfac0-a271-4301-a8a9-519bb8d9ad75 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:30.430985 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfac0-a271-4301-a8a9-519bb8d9ad75 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:30.431089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfac0-a271-4301-a8a9-519bb8d9ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:30.449781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8f9dfac0-a271-4301-a8a9-519bb8d9ad75 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:30.450999 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f9dfac0-a271-4301-a8a9-519bb8d9ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:30.481130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:30.519725 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 650/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:05:30.550100 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579af48-4d0e-422e-be02-3b370656b499 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:30.593751 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:30.669515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579af48-4d0e-422e-be02-3b370656b499 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:30.704665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:30.705256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:30.705536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:30.705809 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:30.706575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:30.707990 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa60b5-4c93-4c3c-a658-c841a2d3433d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:30.724249 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 645/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 11 20:05:30 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:05:32.687126 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8841e0-cbea-40bb-95c7-ff31fc13d461 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:32.687684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8841e0-cbea-40bb-95c7-ff31fc13d461 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:32.687684 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8841e0-cbea-40bb-95c7-ff31fc13d461 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:32.689062 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 651/1296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:32.695352 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:32.696052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:32.696197 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:32.718508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:32.719698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:32.800175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 646/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:05:32.831020 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8841e0-cbea-40bb-95c7-ff31fc13d461 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:32.948255 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8841e0-cbea-40bb-95c7-ff31fc13d461 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:32.983523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:32.984329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:32.984610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:32.984883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:32.985543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:32.986958 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:32.999463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:33.000590 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:33.001780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 652/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:05:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:33.008135 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:33.026941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:33.107007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d57a28-83af-4a30-95e4-8ede814d8531 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:33.142302 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:33.142966 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:33.143248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:33.143524 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:33.144231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:33.144540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:33.146007 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:33.151332 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 647/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 11 20:05:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:33.157446 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:33.190536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:33.260882 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e143-3b79-4a52-b2d5-7774fa86c4eb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:33.299560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:33.300219 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:33.300500 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:33.300779 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:33.301612 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] RBAC: Adding query filter params (interface=public, service_id=f23f7e3862ae4faa8c82226ed7669a4a, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:33.301942 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:33.303354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b52c3-fb50-4ae1-af11-804977a06be1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:33.308897 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 653/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 11 20:05:33 2022] GET /identity/v3/endpoints?service_id=f23f7e3862ae4faa8c82226ed7669a4a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:05:33.315326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:33.417620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:33.439186 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31e9fa-a8cd-45d4-ab80-17fd6d99c4ae None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:33.476695 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:33.477347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:33.477628 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:33.477906 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:33.478625 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:33.479997 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebefbb-3296-41c3-bd88-f4bbc233d2fb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:33.486857 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 648/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 11 20:05:33 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:05:35.489502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0cdf-436f-4afd-8843-860dd54c6f76 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:35.490374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0cdf-436f-4afd-8843-860dd54c6f76 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:35.490541 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0cdf-436f-4afd-8843-860dd54c6f76 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:35.492760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 654/1302] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:05:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:05:35.500570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:35.501026 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:35.501119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:35.519744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:05:35.520978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:05:35.599738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 649/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:05:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:05:35.625649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff0cdf-436f-4afd-8843-860dd54c6f76 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:35.740440 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:35.748291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff0cdf-436f-4afd-8843-860dd54c6f76 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:35.783036 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:35.783835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:35.784118 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:35.784393 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:35.785051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:35.786522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:05:35.798763 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:05:35.799874 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jul 11 20:05:35.800922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 655/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 11 20:05:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:05:35.806851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:35.886667 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:35.912883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f46ee-782b-48c1-b172-d4d6d2ccdba4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:35.948512 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:35.949173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:35.949446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:35.949721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:35.950459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:05:35.950775 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:35.952149 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab00ec-49af-465a-910c-b3f2ff2d8664 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:35.957394 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 650/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 11 20:05:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:05:35.963509 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:05:36.080154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955646c5-cd68-4472-92c7-7c7c4b0f4ee7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:05:36.115259 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:05:36.115885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:05:36.116232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:05:36.116508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:05:36.117252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:05:36.118666 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9813e6-ddf7-4b05-a93d-d0e440e0e536 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:05:36.147463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 656/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 11 20:05:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:05:45.954248 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=30 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:05:46.139437 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:38.580868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6ec4-4f64-43ac-834d-03fe4b7f86de None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:38.582420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6ec4-4f64-43ac-834d-03fe4b7f86de None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:38.583035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6ec4-4f64-43ac-834d-03fe4b7f86de None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:38.585898 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 651/1307] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:38.591210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a198f-7267-4391-94be-88ba911f5473 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:38.591668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a198f-7267-4391-94be-88ba911f5473 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:38.591766 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a198f-7267-4391-94be-88ba911f5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:38.675983 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8a4a198f-7267-4391-94be-88ba911f5473 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:38.677200 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8a4a198f-7267-4391-94be-88ba911f5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:38.869536 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 657/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:38.921171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e264-946c-4803-839b-14eb3365669f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:38.921463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e264-946c-4803-839b-14eb3365669f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:38.921828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e264-946c-4803-839b-14eb3365669f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:38.923514 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 652/1309] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 11 20:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:38.939871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790233-4a00-45c8-8ad6-369cd84b38b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:38.940216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790233-4a00-45c8-8ad6-369cd84b38b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:38.940447 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790233-4a00-45c8-8ad6-369cd84b38b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:39.046336 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cd790233-4a00-45c8-8ad6-369cd84b38b3 None None] MFA Rules not processed for user `3d4f3e1239ec40daa85aec5e2825b161`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:39.047709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cd790233-4a00-45c8-8ad6-369cd84b38b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:39.070001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:39.129979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 658/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 11 20:06:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:39.138853 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1e264-946c-4803-839b-14eb3365669f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:39.140663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6be1e264-946c-4803-839b-14eb3365669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:39.250074 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1e264-946c-4803-839b-14eb3365669f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:39.325266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:39.325918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:39.326227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:39.326493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:39.328146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:39.384572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:39.442305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:39.443747 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d21c4-efc0-40f0-8a42-72dc23bfc28f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:39.462815 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 653/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:06:41.746132 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee77268-2dc6-43c3-9130-e84b3dbd14dd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:41.746722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee77268-2dc6-43c3-9130-e84b3dbd14dd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:41.746722 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee77268-2dc6-43c3-9130-e84b3dbd14dd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:41.748194 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 659/1312] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:41.753341 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e91e-f4b7-4fde-8297-6e46f2f99c9f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:41.753822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e91e-f4b7-4fde-8297-6e46f2f99c9f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:41.753937 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e91e-f4b7-4fde-8297-6e46f2f99c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:41.826932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1432e91e-f4b7-4fde-8297-6e46f2f99c9f None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:41.828137 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1432e91e-f4b7-4fde-8297-6e46f2f99c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:41.924965 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 654/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:41.977634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:41.978077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:41.978433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:41.979979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 660/1314] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 11 20:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:41.986748 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318ab7-34a6-4080-af49-9d0a36570b7d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:41.987004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318ab7-34a6-4080-af49-9d0a36570b7d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:41.987297 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e318ab7-34a6-4080-af49-9d0a36570b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:41.998070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:42.069993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6e318ab7-34a6-4080-af49-9d0a36570b7d None None] MFA Rules not processed for user `3d4f3e1239ec40daa85aec5e2825b161`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:42.071269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6e318ab7-34a6-4080-af49-9d0a36570b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:42.152684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 655/1315] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 11 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:42.161762 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:42.163351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:42.274406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de852a-3e54-40ac-aa2c-3bcd54a30228 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:42.356484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:42.359282 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:42.359949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:42.360490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:42.360772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:42.362865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:42.482513 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:42.483949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b689-dd6e-4a03-b461-05d71565a27c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:42.504084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 661/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:06:45.075413 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:45.075902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:45.076022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:45.077359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 656/1317] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:45.082670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4be0-b09f-4f7e-9f52-2c0910e7876e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:45.083076 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4be0-b09f-4f7e-9f52-2c0910e7876e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:45.083224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4be0-b09f-4f7e-9f52-2c0910e7876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:45.151433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c4dd4be0-b09f-4f7e-9f52-2c0910e7876e None None] MFA Rules not processed for user `acbf13c7456e4e498e3a2495f8b4838b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:45.152633 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c4dd4be0-b09f-4f7e-9f52-2c0910e7876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:45.209552 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:45.259878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 662/1318] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:45.298825 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:45.300456 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:45.414669 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319a712-8503-4085-91bd-f1a71af9b0a9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:45.419684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:45.493157 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:45.493806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:45.494113 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:45.494394 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:45.496039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:45.622498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:45.623851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db42e5-00f5-42d1-a210-835dc532c777 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:45.643982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 657/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:06:48.358299 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:48.359057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:48.359190 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:48.361564 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 663/1320] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:48.366963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b02f-143c-48e9-9ae0-3d94214f2bc8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:48.367427 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b02f-143c-48e9-9ae0-3d94214f2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:48.367523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b02f-143c-48e9-9ae0-3d94214f2bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:48.408745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:48.439437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8a55b02f-143c-48e9-9ae0-3d94214f2bc8 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:48.440684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8a55b02f-143c-48e9-9ae0-3d94214f2bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:48.555531 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 658/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:48.594468 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:48.595984 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:48.705812 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ebd39-19ad-47e4-95b7-c0f0ed1fce88 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:48.783201 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:48.784168 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:48.784662 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:48.784940 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:48.786679 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:48.794373 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:48.899406 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:48.900780 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da035b-2cf2-43e0-8aeb-398b311f938b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:48.924305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 664/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:06:51.650904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:51.651576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:51.651576 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:51.652793 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 659/1323] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:51.658337 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe878b-f21d-43a7-bf5a-eecdaf8be547 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:51.658788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe878b-f21d-43a7-bf5a-eecdaf8be547 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:51.658898 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe878b-f21d-43a7-bf5a-eecdaf8be547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:51.729274 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-61fe878b-f21d-43a7-bf5a-eecdaf8be547 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:51.730543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61fe878b-f21d-43a7-bf5a-eecdaf8be547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:51.795382 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:51.842256 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 665/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:51.878620 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:51.880176 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:51.990188 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eae44-ed19-4831-9975-e0966610e499 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:52.002316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:52.066984 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:52.067634 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:52.067917 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:52.068189 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:52.069843 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:52.185235 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:52.186605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b5f7-610b-4e3b-a004-bf4fe734dcb5 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:52.204828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 660/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:06:54.263512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:54.264100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:54.264100 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:54.265415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 666/1326] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:54.271135 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8c95-952d-486a-850d-30909f7fc915 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:54.271623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8c95-952d-486a-850d-30909f7fc915 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:54.271725 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8c95-952d-486a-850d-30909f7fc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:54.322144 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:54.341990 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-66ba8c95-952d-486a-850d-30909f7fc915 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:54.343243 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-66ba8c95-952d-486a-850d-30909f7fc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:54.444484 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 661/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:54.480484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:54.482080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:54.594904 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b9be-571d-4071-9942-b2c33b85d364 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:54.673208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:54.673859 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:54.674163 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:54.674435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:54.676105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:54.693232 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:54.798686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:54.800246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace972-63e8-4fff-a356-821f470d3ae3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:54.820463 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 667/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:06:56.929464 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:56.930053 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:56.930713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:56.933905 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 662/1329] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:56.942480 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f267-832d-4a1f-bea6-3da858846a0c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:56.942991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f267-832d-4a1f-bea6-3da858846a0c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:56.942991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f267-832d-4a1f-bea6-3da858846a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:57.023033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8fb3f267-832d-4a1f-bea6-3da858846a0c None None] MFA Rules not processed for user `acbf13c7456e4e498e3a2495f8b4838b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:57.024245 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8fb3f267-832d-4a1f-bea6-3da858846a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:57.090847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:57.123824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 668/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:06:57.160960 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:06:57.162525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:57.273313 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3b436-c7d6-460e-8595-7f7b9b5a01ff None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:06:57.293985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:57.355411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:06:57.356503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:57.357006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:57.357490 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:57.359765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:57.501317 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:06:57.502871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe751-d844-437f-8a9e-b5f0b8fe6209 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:06:57.522668 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 663/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:06:59.762645 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35402-3480-4212-b636-0671e365d838 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:59.763543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35402-3480-4212-b636-0671e365d838 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:59.763543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35402-3480-4212-b636-0671e365d838 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:59.765683 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 669/1332] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:06:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:06:59.772042 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794999a-2a9a-4eb1-93fb-f3cba4b3aff7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:06:59.772784 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794999a-2a9a-4eb1-93fb-f3cba4b3aff7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:06:59.772945 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794999a-2a9a-4eb1-93fb-f3cba4b3aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:06:59.842963 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:06:59.845935 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5794999a-2a9a-4eb1-93fb-f3cba4b3aff7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:06:59.848134 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5794999a-2a9a-4eb1-93fb-f3cba4b3aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:06:59.964512 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 664/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:00.000267 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b35402-3480-4212-b636-0671e365d838 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:00.002787 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-52b35402-3480-4212-b636-0671e365d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:00.122482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b35402-3480-4212-b636-0671e365d838 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:00.195484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:00.196125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:00.196367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:00.196661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:00.198322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:00.224890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:00.313277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:00.314778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab529b-f108-409c-97f0-f0ebdf6606cd service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:00.334936 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 670/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:02.423505 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:02.424326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:02.424326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:02.426055 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 665/1335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:02.432328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8315b6c-ffb8-49b0-8fb1-11e032c1dc79 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:02.433077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8315b6c-ffb8-49b0-8fb1-11e032c1dc79 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:02.433217 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8315b6c-ffb8-49b0-8fb1-11e032c1dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:02.516669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b8315b6c-ffb8-49b0-8fb1-11e032c1dc79 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:02.518494 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b8315b6c-ffb8-49b0-8fb1-11e032c1dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:02.594981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:02.619433 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 671/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:02.663198 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:02.664730 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:02.770969 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4214-0258-44f0-94ed-e322b56bf451 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:02.811683 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:02.858572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:02.859160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:02.859437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:02.859708 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:02.861348 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:02.975698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:02.977143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de033c4e-d115-45f5-8aae-d4aca8a60f55 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:02.995437 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 666/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:07:05.345825 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:05.346424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:05.346424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:05.347986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 672/1338] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:05.354439 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500e3f-79c2-43a4-8b0c-58349b4d06cd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:05.354854 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500e3f-79c2-43a4-8b0c-58349b4d06cd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:05.355065 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06500e3f-79c2-43a4-8b0c-58349b4d06cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:05.425820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-06500e3f-79c2-43a4-8b0c-58349b4d06cd None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:05.427088 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-06500e3f-79c2-43a4-8b0c-58349b4d06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:05.436064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:05.527112 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 667/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:05.563202 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:05.565079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:05.694398 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2b01-807b-48d6-b329-ad4ab60d6c81 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:05.769150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:05.769801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:05.770089 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:05.770390 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:05.772261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:05.811654 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:05.893424 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:05.895719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae3932-790e-4dbd-8350-87092f18a0bb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:05.920072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 673/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:09.836409 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:09.836920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:09.836920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:09.838512 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 668/1341] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:09.843588 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326bd2-14ab-4acc-aa7f-5df0de7d97da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:09.844051 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326bd2-14ab-4acc-aa7f-5df0de7d97da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:09.844148 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326bd2-14ab-4acc-aa7f-5df0de7d97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:09.910422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-06326bd2-14ab-4acc-aa7f-5df0de7d97da None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:09.911556 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-06326bd2-14ab-4acc-aa7f-5df0de7d97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:09.999796 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:10.012147 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 674/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:10.050396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:10.051929 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:10.164404 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de342e09-bed9-4074-ab29-c7d7e54d4aa3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:10.203631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:10.241663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:10.242350 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:10.242599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:10.242894 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:10.244546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:10.357518 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:10.359070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fedb4-f922-40b7-94a7-c808b62d2615 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:10.377032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 669/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:13.067889 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:13.068475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:13.068475 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:13.069870 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 675/1344] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:13.075803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34603e5-c9d8-40ca-b0b7-2de362f4aa00 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:13.076329 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34603e5-c9d8-40ca-b0b7-2de362f4aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:13.076329 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34603e5-c9d8-40ca-b0b7-2de362f4aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:13.143765 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f34603e5-c9d8-40ca-b0b7-2de362f4aa00 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:13.144982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f34603e5-c9d8-40ca-b0b7-2de362f4aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:13.163028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:13.250486 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 670/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:13.287378 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:13.288916 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:13.391354 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077640-a3bd-45ad-92f2-621fc074f7b5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:13.464483 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:13.465134 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:13.465401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:13.465669 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:13.467330 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:13.511745 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:13.581357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:13.583320 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80490a13-7229-437e-aa98-ad826924c189 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:13.602777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 676/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:18.007422 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:18.007955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:18.007955 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:18.009401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 671/1347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:18.015363 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12907f8-4733-4863-b3e4-1c327a3a4bb1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:18.015910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12907f8-4733-4863-b3e4-1c327a3a4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:18.015910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12907f8-4733-4863-b3e4-1c327a3a4bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:18.086338 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f12907f8-4733-4863-b3e4-1c327a3a4bb1 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:18.087619 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f12907f8-4733-4863-b3e4-1c327a3a4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:18.201030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:18.203954 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 677/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:07:18.241570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:18.243123 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:18.350596 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3188b-2e3d-48e2-985c-c1b989449ed9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:18.401851 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:18.430544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:18.431148 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:18.431429 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:18.431703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:18.433685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:18.544685 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:18.546124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4018e6-750b-45e6-a9e3-ef34477ca0e1 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:18.564335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 672/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:23.436784 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba66d9-ff6e-41ba-a0a9-94077b45f5bb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:23.437313 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba66d9-ff6e-41ba-a0a9-94077b45f5bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:23.437418 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba66d9-ff6e-41ba-a0a9-94077b45f5bb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:23.438939 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 678/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 11 20:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:23.447215 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4074-2eb9-41a6-86aa-01a0a68d127d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:23.447647 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4074-2eb9-41a6-86aa-01a0a68d127d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:23.447832 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4074-2eb9-41a6-86aa-01a0a68d127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:23.552701 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-638a4074-2eb9-41a6-86aa-01a0a68d127d None None] MFA Rules not processed for user `edf638c8b45e4a3f965d57837e222f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:23.559635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-638a4074-2eb9-41a6-86aa-01a0a68d127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:23.589673 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:23.707583 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 673/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 11 20:07:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:27.955905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85206a-098a-492e-9914-56546b5b7158 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:27.956948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85206a-098a-492e-9914-56546b5b7158 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:27.957432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85206a-098a-492e-9914-56546b5b7158 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:27.959394 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 679/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 11 20:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:27.964956 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881249e-2600-4df0-bf58-92b18f8df4a5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:27.965847 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881249e-2600-4df0-bf58-92b18f8df4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:27.966360 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881249e-2600-4df0-bf58-92b18f8df4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:28.041365 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5881249e-2600-4df0-bf58-92b18f8df4a5 None None] MFA Rules not processed for user `edf638c8b45e4a3f965d57837e222f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:28.043047 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5881249e-2600-4df0-bf58-92b18f8df4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:28.115423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:28.154175 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 674/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 11 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:29.431543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b267c4-a3ef-4852-b544-b9d4180569c1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:29.432097 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b267c4-a3ef-4852-b544-b9d4180569c1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:29.432331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b267c4-a3ef-4852-b544-b9d4180569c1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:29.434052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 680/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 11 20:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:29.439498 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337488-4b6f-44be-b38e-8e701f644a8e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:29.439968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337488-4b6f-44be-b38e-8e701f644a8e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:29.440070 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337488-4b6f-44be-b38e-8e701f644a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:29.516186 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d5337488-4b6f-44be-b38e-8e701f644a8e None None] MFA Rules not processed for user `edf638c8b45e4a3f965d57837e222f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:29.517434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d5337488-4b6f-44be-b38e-8e701f644a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:29.627465 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 675/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 11 20:07:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:33.049310 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b429d-8395-4a81-9c35-c96d3cc60c81 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:33.049855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b429d-8395-4a81-9c35-c96d3cc60c81 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:33.049855 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b429d-8395-4a81-9c35-c96d3cc60c81 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:33.051345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 681/1356] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:33.058558 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7b7-2ec7-4be9-a296-e8dc468bade1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:33.059032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7b7-2ec7-4be9-a296-e8dc468bade1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:33.059170 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7b7-2ec7-4be9-a296-e8dc468bade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:33.100021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:33.142095 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-02caf7b7-2ec7-4be9-a296-e8dc468bade1 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:33.143420 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-02caf7b7-2ec7-4be9-a296-e8dc468bade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:33.247646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 676/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:33.301355 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:33.301878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:33.302407 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:33.304072 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 682/1358] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 11 20:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:07:33.311794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e26e-d4ac-4377-9efb-3410b8578186 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:33.312366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e26e-d4ac-4377-9efb-3410b8578186 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:33.312983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e26e-d4ac-4377-9efb-3410b8578186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:33.407601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3ec1e26e-d4ac-4377-9efb-3410b8578186 None None] MFA Rules not processed for user `a71d566879c44440bc4675b59c6d54e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:33.408868 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3ec1e26e-d4ac-4377-9efb-3410b8578186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:33.460631 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:33.531330 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 677/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 11 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:33.539805 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:33.541445 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:33.701434 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e974-e7ea-4dfe-b790-10039cb13eea None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:33.779721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:33.828734 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:33.829484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:33.829865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:33.830261 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:33.832223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:33.934699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:33.936443 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b630-8259-40d6-8e42-5c5e560fd1c6 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:33.956069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 683/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:36.166381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:36.166942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:36.166942 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:36.168463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 678/1361] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:36.173759 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4e59b-6706-4fbc-8ad1-497928df9d2a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:36.174504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4e59b-6706-4fbc-8ad1-497928df9d2a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:36.174504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4e59b-6706-4fbc-8ad1-497928df9d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:36.243496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-59e4e59b-6706-4fbc-8ad1-497928df9d2a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:36.244714 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-59e4e59b-6706-4fbc-8ad1-497928df9d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:36.287343 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:36.352049 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 684/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:36.395991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:36.397523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:36.567494 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fb02-cd57-4ba4-a4a6-d36acc5a2c58 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:36.581675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:36.735980 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:36.736703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:36.736982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:36.738015 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:36.739759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:36.839358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:36.841066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c66c8-00e1-4060-aba8-039e862af307 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:36.859689 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 679/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:39.198001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66762-1e3f-499a-aa3c-21bc5778dda5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:39.198549 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66762-1e3f-499a-aa3c-21bc5778dda5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:39.198646 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66762-1e3f-499a-aa3c-21bc5778dda5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:39.200057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 685/1364] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:39.205601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eaff-3f07-4961-92d8-2167c45b0844 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:39.206076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eaff-3f07-4961-92d8-2167c45b0844 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:39.206288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eaff-3f07-4961-92d8-2167c45b0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:39.227343 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:39.294893 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-de80eaff-3f07-4961-92d8-2167c45b0844 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:39.296122 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-de80eaff-3f07-4961-92d8-2167c45b0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:39.397337 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 680/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:39.446829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:39.447419 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:39.447771 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:39.449844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 686/1366] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 11 20:07:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:39.455553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bb6a-df38-4f66-bb3f-f1587c510f5d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:39.455841 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bb6a-df38-4f66-bb3f-f1587c510f5d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:39.456096 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bb6a-df38-4f66-bb3f-f1587c510f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:39.536300 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2d96bb6a-df38-4f66-bb3f-f1587c510f5d None None] MFA Rules not processed for user `a71d566879c44440bc4675b59c6d54e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:39.537533 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2d96bb6a-df38-4f66-bb3f-f1587c510f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:39.576029 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:39.661629 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 681/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 11 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:07:39.669381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:39.670955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:39.830196 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a979-ded2-4970-a50d-7bad0303a5ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:39.852861 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:39.950632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:39.951294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:39.951577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:39.951858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:39.953533 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:40.046931 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:40.048553 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd2b6a-72c3-4a16-8591-512850a3d796 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:40.067878 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 687/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:41.101358 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be464483-6e0c-4bdc-8678-049ef624fb83 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:41.101920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be464483-6e0c-4bdc-8678-049ef624fb83 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:41.101920 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be464483-6e0c-4bdc-8678-049ef624fb83 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:41.103506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 682/1369] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:41.110228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba45-8cd5-4fa3-8262-a02caaaf5157 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:41.110651 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba45-8cd5-4fa3-8262-a02caaaf5157 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:41.110758 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba45-8cd5-4fa3-8262-a02caaaf5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:41.144179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:41.181841 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3cffba45-8cd5-4fa3-8262-a02caaaf5157 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:41.183401 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3cffba45-8cd5-4fa3-8262-a02caaaf5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:41.285947 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 688/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:41.628550 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:41.628720 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:41.628865 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:41.630971 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 683/1371] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jul 11 20:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:41.635603 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e4e4-42c8-43d7-b58f-d50e75b966db None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:41.635890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e4e4-42c8-43d7-b58f-d50e75b966db None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:41.636167 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e4e4-42c8-43d7-b58f-d50e75b966db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:41.715251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8040e4e4-42c8-43d7-b58f-d50e75b966db None None] MFA Rules not processed for user `d90591da6da54f888a3faf530b103888`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:41.716431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8040e4e4-42c8-43d7-b58f-d50e75b966db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:41.769223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:41.803273 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 689/1372] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jul 11 20:07:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:41.811234 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:41.813031 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:41.935858 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6950-c7dc-4aeb-88d4-4b1b07942ad6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:41.977773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:42.013687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90591da6da54f888a3faf530b103888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:42.014368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:42.014646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:42.014904 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:42.016547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:42.137519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:42.138962 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f808a-0cd2-49f3-9432-e8e8c29bf807 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:42.158417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 684/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:42.217432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:42.217875 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:42.218098 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:42.219923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 690/1374] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:42.225062 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750f24-795b-4400-adbe-6c1cf90e2467 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:42.225497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750f24-795b-4400-adbe-6c1cf90e2467 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:42.225759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750f24-795b-4400-adbe-6c1cf90e2467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:42.298512 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c1750f24-795b-4400-adbe-6c1cf90e2467 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:42.299994 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c1750f24-795b-4400-adbe-6c1cf90e2467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:42.324076 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:42.410570 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 685/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:42.456264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:42.459216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:42.622388 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051410c-84f2-4089-aaee-e45f17a60e9d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:42.675635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:42.737751 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:42.738432 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:42.738716 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:42.738988 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:42.740636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:42.845849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:42.847621 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa7bbb-6374-47ff-a36a-364c6a22b2f9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:42.865642 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 691/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:44.899745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:44.900264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:44.900264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:44.901698 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 686/1377] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:44.907077 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91f26-53ab-469a-90dd-ee873f189ccd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:44.907501 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91f26-53ab-469a-90dd-ee873f189ccd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:44.907596 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91f26-53ab-469a-90dd-ee873f189ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:44.984924 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-64c91f26-53ab-469a-90dd-ee873f189ccd None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:44.986482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64c91f26-53ab-469a-90dd-ee873f189ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:44.993981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:45.088664 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 692/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:45.144791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:45.150068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:45.296201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b85c0-215a-4894-b989-94115a93527e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:45.300052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:45.408795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:45.409373 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:45.409658 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:45.409933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:45.411613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:45.523822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:45.525428 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e472b6-fad8-48c3-b15d-95db8090dcc9 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:45.553803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 687/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:47.606719 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:47.607365 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:47.607365 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:47.608883 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 693/1380] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:47.615164 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1f2b-7cd8-4b70-9c23-6aae033ba665 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:47.615743 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1f2b-7cd8-4b70-9c23-6aae033ba665 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:47.616335 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1f2b-7cd8-4b70-9c23-6aae033ba665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:47.628638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:47.693833 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6a4d1f2b-7cd8-4b70-9c23-6aae033ba665 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:47.695400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6a4d1f2b-7cd8-4b70-9c23-6aae033ba665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:47.800201 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 688/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:47.844993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:47.847304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:48.007767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:48.019893 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753226b-8a24-4c32-bf52-83ec8e6cc7aa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:48.141595 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:48.142328 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:48.142731 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:48.143173 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:48.145125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:48.241020 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:48.242803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65c03-1b72-4995-90aa-afc3bf039ccf service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:48.254216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:48.264083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 694/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:50.391463 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:50.392043 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:50.392382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:50.393979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 689/1383] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:50.399425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e372-d0e1-42c2-91df-57b525132055 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:50.399922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e372-d0e1-42c2-91df-57b525132055 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:50.400027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e372-d0e1-42c2-91df-57b525132055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:50.472740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1f10e372-d0e1-42c2-91df-57b525132055 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:50.473975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f10e372-d0e1-42c2-91df-57b525132055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:50.582911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 695/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:50.624054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:50.625588 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:50.709670 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:50.777896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6bfbd-1dc1-4b66-aad0-29616979adcd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:50.896160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:50.896812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:50.897117 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:50.897369 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:50.899048 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:50.951387 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:50.991792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:50.993382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e175a39-2bf3-4432-aafc-68ebfa63c139 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:51.011863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 690/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:53.028111 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:53.028944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:53.028944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:53.030335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 696/1386] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:53.035702 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceec4e-2acd-48ff-8af7-2db2eb76888b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:53.036295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceec4e-2acd-48ff-8af7-2db2eb76888b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:53.036295 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceec4e-2acd-48ff-8af7-2db2eb76888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:53.106240 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-61ceec4e-2acd-48ff-8af7-2db2eb76888b None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:53.107310 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-61ceec4e-2acd-48ff-8af7-2db2eb76888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:53.205402 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 691/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:07:53.249522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:53.251183 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:53.328576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:53.398254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b03b-b12e-4ed5-acc1-693e717d752f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:53.527909 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:53.528576 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:53.528860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:53.529136 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:53.530844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:53.574491 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:53.630991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:53.632658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18ed95-b27f-4ea2-88b5-3337205047aa service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:53.653649 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 697/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:55.667493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:55.668227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:55.668227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:55.669783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 692/1389] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:07:55.676141 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d277-18a1-42fd-8aa1-2693e5d0285e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:55.676750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d277-18a1-42fd-8aa1-2693e5d0285e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:55.676750 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d277-18a1-42fd-8aa1-2693e5d0285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:55.741527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f360d277-18a1-42fd-8aa1-2693e5d0285e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:55.742781 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f360d277-18a1-42fd-8aa1-2693e5d0285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:55.844948 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 698/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:55.888189 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:55.890244 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:55.926970 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:56.045648 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38f275-d612-4942-aac3-34e2200d4e07 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:56.163357 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:56.175999 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:56.176773 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:56.177124 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:56.177305 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:56.179119 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:56.283544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:56.285166 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f7cf-ffdb-4ac7-9183-b654ead620c0 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:56.305680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 693/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:07:58.345574 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f9f-5265-4b1e-9e8c-ff0b96de1b7c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.346234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f9f-5265-4b1e-9e8c-ff0b96de1b7c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.346234 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f9f-5265-4b1e-9e8c-ff0b96de1b7c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.347566 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 699/1392] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:58.352930 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.353382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.353488 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.421774 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:58.423005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:58.486116 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:58.503276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73108a7-4e4c-4c7a-9304-880325a66ec3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.503562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73108a7-4e4c-4c7a-9304-880325a66ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.503840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73108a7-4e4c-4c7a-9304-880325a66ec3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.505298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 700/1393] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:07:58.510344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30a56-8773-48c0-aa23-c18c9f2fb533 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.510636 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30a56-8773-48c0-aa23-c18c9f2fb533 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.510896 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30a56-8773-48c0-aa23-c18c9f2fb533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.530067 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 694/1394] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:58.530304 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:58.573406 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:58.574835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:58.580962 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cfd30a56-8773-48c0-aa23-c18c9f2fb533 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:58.582223 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfd30a56-8773-48c0-aa23-c18c9f2fb533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:58.680928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 701/1395] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:07:58.687246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4abd43-c762-489d-8c06-71f697987b24 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:58.743853 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71032e8-5568-4524-ae6f-1be97a1f2766 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.744129 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71032e8-5568-4524-ae6f-1be97a1f2766 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.744414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71032e8-5568-4524-ae6f-1be97a1f2766 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.745821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 702/1396] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 11 20:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:07:58.750512 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.750797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.751071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.763247 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:58.804727 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:58.805370 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:58.805649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:58.805926 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:58.807897 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:58.829959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] MFA Rules not processed for user `3e257ac3d850495e8c06e4c9cb01e29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:58.831216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:58.867409 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:58.913772 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 703/1397] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 11 20:07:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:07:58.919061 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:58.920722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957326-5292-480b-be37-aba3d8ab984d service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:58.925054 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:07:58.933135 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b59182-1b30-40ca-b586-49c3a5a9794f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:07:58.939781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 695/1398] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:07:59.016801 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e257ac3d850495e8c06e4c9cb01e29c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:07:59.017484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:59.017767 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:59.018052 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:59.019862 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:07:59.150385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:07:59.156357 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:07:59.157836 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbebcd-17c0-4e0f-8ef1-58904781b281 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:07:59.177258 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 704/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:07:59.898316 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3383-2505-4841-ac13-f71cc4ff5530 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:07:59.898808 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3383-2505-4841-ac13-f71cc4ff5530 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:07:59.899024 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3383-2505-4841-ac13-f71cc4ff5530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:07:59.967559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-acbd3383-2505-4841-ac13-f71cc4ff5530 None None] MFA Rules not processed for user `a6cb7e0a02644c76b2acd43e1717b1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:07:59.968794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-acbd3383-2505-4841-ac13-f71cc4ff5530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:00.010766 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:00.062729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 696/1400] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 11 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:00.105170 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:00.105688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:00.105797 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:00.107178 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 705/1401] 10.222.0.16 () {54 vars in 942 bytes} [Mon Jul 11 20:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:00.114896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db48e-92bc-4681-84b6-1f1db11c7514 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:00.114896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db48e-92bc-4681-84b6-1f1db11c7514 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:00.114896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db48e-92bc-4681-84b6-1f1db11c7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:00.189506 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2b4db48e-92bc-4681-84b6-1f1db11c7514 None None] MFA Rules not processed for user `7368871bcd14466cb7513218ad0f003c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:00.190729 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2b4db48e-92bc-4681-84b6-1f1db11c7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:00.309948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 697/1402] 10.222.0.16 () {58 vars in 1039 bytes} [Mon Jul 11 20:08:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:00.319464 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:00.321224 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:00.461794 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739cd72-7fc5-4bd8-af6b-c0871f21e00d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:00.535049 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:00.571727 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7368871bcd14466cb7513218ad0f003c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:00.572459 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:00.572742 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:00.573034 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:00.574905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:00.661192 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:00.662778 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3910c6-077c-44d6-9a61-3382b9f45a67 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:00.671251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 706/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 11 20:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 20:08:01.018932 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:01.019497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:01.019497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:01.020859 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 698/1404] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:01.026266 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7f0d-4376-47a1-94b7-169159f09174 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:01.026562 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7f0d-4376-47a1-94b7-169159f09174 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:01.026843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7f0d-4376-47a1-94b7-169159f09174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:01.107844 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-84dd7f0d-4376-47a1-94b7-169159f09174 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:01.109088 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-84dd7f0d-4376-47a1-94b7-169159f09174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:01.167589 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:01.211151 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 707/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:01.254619 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:01.257878 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:01.272902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:01.428290 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0453b0-1ab1-4746-a1be-60ddf38cea8e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:01.517975 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:01.552613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:01.553206 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:01.553480 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:01.553874 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:01.555582 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:01.694820 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:01.696594 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd3e60-3e6c-4bdd-9882-1bb9c767cfab service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:01.716093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 699/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:03.779907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:03.780507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:03.780507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:03.786413 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 708/1407] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:08:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:03.787306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda5c2-ef00-4dcd-8d64-a151a8e156a5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:03.787768 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda5c2-ef00-4dcd-8d64-a151a8e156a5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:03.788035 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda5c2-ef00-4dcd-8d64-a151a8e156a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:03.864882 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-41cda5c2-ef00-4dcd-8d64-a151a8e156a5 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:03.866158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-41cda5c2-ef00-4dcd-8d64-a151a8e156a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:03.913896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:03.970877 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 700/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:04.014149 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:04.015699 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:04.169738 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7472-8168-40c2-b3a1-775c03a65291 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:04.213499 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:04.293071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:04.293833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:04.294156 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:04.294435 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:04.296103 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:04.396960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:04.398653 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d897d-324d-4923-a30a-291dfc5371a3 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:04.417377 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 709/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:13.968523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=23 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:14.414620 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=79 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:22.568359 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c344d-8b5c-4f8e-9f41-b78c622d50bd None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:22.568948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c344d-8b5c-4f8e-9f41-b78c622d50bd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:22.568948 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c344d-8b5c-4f8e-9f41-b78c622d50bd None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:22.570312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 701/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 11 20:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:22.576139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46427-afb9-4b64-be2c-cf1be028ebe9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:22.576577 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46427-afb9-4b64-be2c-cf1be028ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:22.576726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46427-afb9-4b64-be2c-cf1be028ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:22.653252 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-96e46427-afb9-4b64-be2c-cf1be028ebe9 None None] MFA Rules not processed for user `edf638c8b45e4a3f965d57837e222f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:22.654414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96e46427-afb9-4b64-be2c-cf1be028ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:22.774057 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 710/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 11 20:08:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:08:22.796200 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881fe7-be75-456e-8d44-b73ecc2874dd None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:22.796546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881fe7-be75-456e-8d44-b73ecc2874dd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:22.796951 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2881fe7-be75-456e-8d44-b73ecc2874dd None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:22.798902 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 702/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 11 20:08:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:22.804017 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67082-4708-4d93-a38b-6b29e3391a8d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:22.804349 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67082-4708-4d93-a38b-6b29e3391a8d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:22.804638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67082-4708-4d93-a38b-6b29e3391a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:22.880964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:22.884400 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e7f67082-4708-4d93-a38b-6b29e3391a8d None None] MFA Rules not processed for user `a71d566879c44440bc4675b59c6d54e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:22.886641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e7f67082-4708-4d93-a38b-6b29e3391a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:23.013047 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 711/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 11 20:08:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:25.527523 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:25.528401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:25.528401 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:25.530625 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:25.536214 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fc6a-4ef7-4e93-a0fd-64dc315b6291 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:25.536676 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fc6a-4ef7-4e93-a0fd-64dc315b6291 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:25.536793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fc6a-4ef7-4e93-a0fd-64dc315b6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:25.605030 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-63f6fc6a-4ef7-4e93-a0fd-64dc315b6291 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:25.606876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-63f6fc6a-4ef7-4e93-a0fd-64dc315b6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:25.667067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:25.711286 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:25.761795 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:25.763355 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:25.915519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff65e3-e433-44db-8ea7-9d3f82b236ac None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:25.997595 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:26.040415 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:26.041093 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:26.041633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:26.041910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:26.043623 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:26.148183 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:26.150271 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266ca1b-5d8b-4cb5-886d-527877112b7f service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:26.172716 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 704/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:27.085305 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:27.086236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:27.086236 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:27.090220 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:27.095368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f28993-f8e3-4c82-9ebb-e00d15e084a7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:27.095829 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f28993-f8e3-4c82-9ebb-e00d15e084a7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:27.095933 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f28993-f8e3-4c82-9ebb-e00d15e084a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:27.175203 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c6f28993-f8e3-4c82-9ebb-e00d15e084a7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:27.176418 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c6f28993-f8e3-4c82-9ebb-e00d15e084a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:27.204052 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:27.286054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:27.445159 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:27.447450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:27.620335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbf923-872b-4cb7-9d31-dd44415852e1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:27.662056 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:27.739380 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:27.740039 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:27.740324 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:27.740608 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:27.742284 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:27.836385 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:27.838015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de8c3-b001-417b-991b-fc1cc6304c99 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:27.856630 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 714/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:28.735064 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80fd1-c028-410d-9c82-680187999589 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:28.735707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80fd1-c028-410d-9c82-680187999589 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:28.735707 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80fd1-c028-410d-9c82-680187999589 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:28.737057 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:28.743208 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b822c-76cb-4255-a7b5-b0fcfd5a45d7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:28.743964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b822c-76cb-4255-a7b5-b0fcfd5a45d7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:28.744090 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b822c-76cb-4255-a7b5-b0fcfd5a45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:28.808130 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:28.832083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d02b822c-76cb-4255-a7b5-b0fcfd5a45d7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:28.833323 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d02b822c-76cb-4255-a7b5-b0fcfd5a45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:28.949697 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:29.115645 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80fd1-c028-410d-9c82-680187999589 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:29.118237 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-41d80fd1-c028-410d-9c82-680187999589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:29.305411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80fd1-c028-410d-9c82-680187999589 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:29.318213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:29.420567 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:29.421143 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:29.421425 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:29.421699 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:29.423496 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:29.519607 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:29.521231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb6d11-eba6-4b01-b38e-328dfee46b54 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:29.540231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 707/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:30.418872 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:30.419316 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:30.419431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:30.420837 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:30.426080 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182b6-30a3-4965-a45c-94dad95ac8c4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:30.426526 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182b6-30a3-4965-a45c-94dad95ac8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:30.426633 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182b6-30a3-4965-a45c-94dad95ac8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:30.446388 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:30.506733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f49182b6-30a3-4965-a45c-94dad95ac8c4 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:30.507979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f49182b6-30a3-4965-a45c-94dad95ac8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:30.612220 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:30.763484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:30.765919 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:30.886880 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:30.926523 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbfdc-6b9c-4a93-b7cf-767efb75f013 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:31.049680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:31.050278 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:31.050558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:31.050835 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:31.052504 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:31.135342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:31.150014 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:31.151680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c1076-386f-4014-91b8-57eaceaa96da service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:31.170067 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 717/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:32.036398 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:32.037288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:32.037288 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:32.039537 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:32.045661 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fc16-5a5b-416b-b715-4c24763e9010 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:32.046157 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fc16-5a5b-416b-b715-4c24763e9010 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:32.046277 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fc16-5a5b-416b-b715-4c24763e9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:32.133745 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8970fc16-5a5b-416b-b715-4c24763e9010 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:32.134925 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8970fc16-5a5b-416b-b715-4c24763e9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:32.233910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:32.387462 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:32.389734 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:32.483039 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:32.545781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bddba2-6305-471c-82be-6fa543d83fbe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:32.671472 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:32.672049 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:32.672326 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:32.672600 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:32.674380 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:32.723451 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:32.773145 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:32.775709 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a64d-5f19-4e64-9300-fa96508bd294 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:32.796534 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 710/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:33.585078 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:33.585674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:33.585674 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:33.587080 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:33.593287 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf5a8-fb11-4a74-8449-9fc296c135ae None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:33.594006 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf5a8-fb11-4a74-8449-9fc296c135ae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:33.594339 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf5a8-fb11-4a74-8449-9fc296c135ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:33.672770 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6b6cf5a8-fb11-4a74-8449-9fc296c135ae None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:33.674779 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6b6cf5a8-fb11-4a74-8449-9fc296c135ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:33.780840 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:33.935811 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:33.938145 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:34.006079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:34.109340 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111729f-07d0-4cfd-8181-a5e373c78325 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:34.247254 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:34.248139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:34.248422 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:34.248747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:34.251467 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:34.259192 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:34.357439 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:34.359849 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05c6d-7097-48e3-bcce-39b732335e40 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:34.386622 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 720/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:35.223441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:35.224021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:35.224021 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:35.225445 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:35.230890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f7ed-2088-4c8b-9f72-e3d0525d9ba7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:35.231335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f7ed-2088-4c8b-9f72-e3d0525d9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:35.231444 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f7ed-2088-4c8b-9f72-e3d0525d9ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:35.309542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3c93f7ed-2088-4c8b-9f72-e3d0525d9ba7 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:35.310798 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3c93f7ed-2088-4c8b-9f72-e3d0525d9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:35.382502 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:35.415641 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:35.565726 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:35.567224 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:35.586572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:35.735322 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb6d9-1ba4-4c28-8a34-a3053fbe41c0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:35.829968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:35.855738 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0497-a904-4069-8214-933058197409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:35.856399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0497-a904-4069-8214-933058197409 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:35.856680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0497-a904-4069-8214-933058197409 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:35.856957 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0497-a904-4069-8214-933058197409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:35.858654 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1abd0497-a904-4069-8214-933058197409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:35.950828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0497-a904-4069-8214-933058197409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:35.952459 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0497-a904-4069-8214-933058197409 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:35.971032 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 713/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:36.772655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:36.773560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:36.773560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:36.775865 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:36.781812 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0ea6-951e-4cde-9e59-b7bcf0b08565 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:36.782665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0ea6-951e-4cde-9e59-b7bcf0b08565 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:36.782760 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0ea6-951e-4cde-9e59-b7bcf0b08565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:36.865263 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8ccd0ea6-951e-4cde-9e59-b7bcf0b08565 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:36.866548 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8ccd0ea6-951e-4cde-9e59-b7bcf0b08565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:36.909005 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:36.972599 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:37.126497 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:37.128871 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:37.292829 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3873-e532-4b94-9596-f8ec0099e1ee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:37.360760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:37.424585 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:37.425195 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:37.425507 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:37.425795 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:37.427600 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:37.524895 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:37.526508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596b87-745a-432b-879c-573b472fd1e2 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:37.545747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 723/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:38.355850 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:38.356446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:38.356446 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:38.357792 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:38.363085 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591129-0796-4db0-8cc7-893a9fbda159 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:38.363539 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591129-0796-4db0-8cc7-893a9fbda159 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:38.363646 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591129-0796-4db0-8cc7-893a9fbda159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:38.442408 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ac591129-0796-4db0-8cc7-893a9fbda159 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:38.443623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ac591129-0796-4db0-8cc7-893a9fbda159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:38.445702 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:38.543044 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:38.697452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:38.698918 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:38.858246 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3f84d-2fa2-4ae9-af7d-8740ed86e8ba None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:38.886665 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:38.982759 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:38.983419 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:38.983694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:38.983961 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:38.985663 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:39.080162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:39.081763 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00eac-1e56-4cd2-92e8-a7660e682a7d service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:39.100863 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 716/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:41.033803 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:41.034785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:41.034785 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:41.036496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:41.042722 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac882-7d96-4951-b0d6-95623ec37314 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:41.043178 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac882-7d96-4951-b0d6-95623ec37314 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:41.043296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac882-7d96-4951-b0d6-95623ec37314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:41.085441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:41.111160 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e94ac882-7d96-4951-b0d6-95623ec37314 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:41.112382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e94ac882-7d96-4951-b0d6-95623ec37314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:41.223651 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:08:41.262112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:41.263720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:41.371033 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51f6f4-83de-462d-ab5a-c496b1042dd4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:41.404738 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:41.447456 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:41.448119 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:41.448404 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:41.448678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:41.450372 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:41.575242 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:41.576792 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a31da-cbbe-4d33-adc7-5c30b099fafc service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:41.595670 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 726/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:43.757155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:43.757895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:43.757895 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:43.759988 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:43.766482 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faacb5-653a-4e88-8001-66f5dd0cd25c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:43.767081 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faacb5-653a-4e88-8001-66f5dd0cd25c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:43.767189 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faacb5-653a-4e88-8001-66f5dd0cd25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:43.836345 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-90faacb5-653a-4e88-8001-66f5dd0cd25c None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:43.837584 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-90faacb5-653a-4e88-8001-66f5dd0cd25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:43.851414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:43.951606 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:43.990772 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:43.992363 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:44.109580 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9e70-11f5-437b-b46d-aa2de1d56288 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:44.123101 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:44.189491 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:44.190171 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:44.190449 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:44.190728 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:44.192395 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:44.307173 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:44.308941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4491d-e60f-4227-8704-01735f39d8b9 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:44.329139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 719/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:46.658905 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:46.659740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:46.659740 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:46.661885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:46.670417 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30128-7b0a-46fe-a783-0d48987cdf30 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:46.671155 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30128-7b0a-46fe-a783-0d48987cdf30 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:46.671329 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30128-7b0a-46fe-a783-0d48987cdf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:46.725010 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:46.744185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b1e30128-7b0a-46fe-a783-0d48987cdf30 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:46.745423 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b1e30128-7b0a-46fe-a783-0d48987cdf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:46.848276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:46.886400 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:46.887981 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:46.999490 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39cc5-31a1-409a-8f8c-573c1fc7c88b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:47.040415 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:47.077943 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:47.078631 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:47.078910 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:47.079181 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:47.080858 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:47.197221 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:47.198720 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e422803-d3e3-452f-aac3-fc0a202a240c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:47.218240 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 729/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:49.364733 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:49.365684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:49.365684 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:49.367985 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:49.376570 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cb8c-ff5f-4cd6-b2eb-da3299dd5823 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:49.376993 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cb8c-ff5f-4cd6-b2eb-da3299dd5823 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:49.377127 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cb8c-ff5f-4cd6-b2eb-da3299dd5823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:49.455374 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3f63cb8c-ff5f-4cd6-b2eb-da3299dd5823 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:49.456610 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f63cb8c-ff5f-4cd6-b2eb-da3299dd5823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:49.478331 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:49.558867 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:49.597551 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:49.599139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:49.719223 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4be8-4679-4802-a0c6-8017acbb67d6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:49.743614 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:49.801353 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:49.801994 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:49.802312 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:49.802587 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:49.804231 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:49.919396 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:49.920844 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb350f-688f-4b64-92a5-8defdba569ce service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:49.939441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 722/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:52.013008 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:52.013647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:52.013647 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:52.014986 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:52.021964 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a118-56b7-418f-858a-ba5f3f14c71a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:52.022694 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a118-56b7-418f-858a-ba5f3f14c71a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:52.022883 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a118-56b7-418f-858a-ba5f3f14c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:52.096754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:52.099597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b2e5a118-56b7-418f-858a-ba5f3f14c71a None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:52.101530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b2e5a118-56b7-418f-858a-ba5f3f14c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:52.209476 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:52.251031 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:52.252658 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:52.368466 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111391c3-e99d-4a6a-a2e5-0ddbfbb1bb8b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:52.423506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:52.453960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:52.454668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:52.454955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:52.455228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:52.456907 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:52.573615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:52.575107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9327-8774-48e7-a577-4051e4e47ee4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:52.595079 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 732/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:54.672266 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:54.672802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:54.672802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:54.674168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:08:54.680799 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f71a2-d4b3-4aad-8853-a5df8338a563 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:54.681522 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f71a2-d4b3-4aad-8853-a5df8338a563 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:54.681821 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f71a2-d4b3-4aad-8853-a5df8338a563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:54.752721 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e04f71a2-d4b3-4aad-8853-a5df8338a563 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:54.753959 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e04f71a2-d4b3-4aad-8853-a5df8338a563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:54.785788 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:54.858885 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:08:54.899440 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:54.901008 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:55.014501 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a894b-dafd-4b74-ad36-025e2377e038 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:55.042211 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:55.088575 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:55.089274 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:55.089585 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:55.089867 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:55.091590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:55.208434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:55.209901 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5945fb-ae35-4f90-b539-ac13ebc20c29 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:55.228403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 725/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:57.322655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:57.323558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:57.323558 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:57.325808 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:57.331680 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a165-44c2-4c7e-a7af-392424314a48 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:57.332158 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a165-44c2-4c7e-a7af-392424314a48 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:57.332257 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a165-44c2-4c7e-a7af-392424314a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:57.409828 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d9f2a165-44c2-4c7e-a7af-392424314a48 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:08:57.411072 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d9f2a165-44c2-4c7e-a7af-392424314a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:57.419256 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:57.515544 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:08:57.555172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:08:57.556761 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:57.669182 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6033-eaca-4b7b-97b0-f4bf7752f7be None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:08:57.726726 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:08:57.747329 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:08:57.747996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:57.748276 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:57.748557 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:57.750264 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:08:57.864314 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:08:57.865776 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8328c6-cd67-4c1b-aaa4-8050e2f2b13b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:08:57.884336 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 735/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:08:59.972655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414024ca-7962-496e-88f3-ce6510601250 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:59.973405 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414024ca-7962-496e-88f3-ce6510601250 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:59.973520 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414024ca-7962-496e-88f3-ce6510601250 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:08:59.975424 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:08:59.983637 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1184-48e6-4928-9967-918e4e493655 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:08:59.984335 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1184-48e6-4928-9967-918e4e493655 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:08:59.984505 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1184-48e6-4928-9967-918e4e493655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:00.063222 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c2d1184-48e6-4928-9967-918e4e493655 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:00.065172 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c2d1184-48e6-4928-9967-918e4e493655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:00.115617 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:00.186527 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:00.227030 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414024ca-7962-496e-88f3-ce6510601250 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:00.228613 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-414024ca-7962-496e-88f3-ce6510601250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:00.338896 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414024ca-7962-496e-88f3-ce6510601250 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:00.377687 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:00.415675 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:00.416368 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:00.416646 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:00.416919 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:00.418776 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:00.561265 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:00.562745 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918c7e5-8087-4b67-9a11-c142c63071d8 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:00.581403 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 728/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:02.634055 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:02.634678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:02.634678 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:02.636019 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:02.641958 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c75e5-963a-411a-8898-eeb8ed3e1fcf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:02.642434 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c75e5-963a-411a-8898-eeb8ed3e1fcf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:02.642546 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c75e5-963a-411a-8898-eeb8ed3e1fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:02.708044 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f93c75e5-963a-411a-8898-eeb8ed3e1fcf None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:02.709179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f93c75e5-963a-411a-8898-eeb8ed3e1fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:02.727991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:02.812382 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:02.848546 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:02.850143 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:02.956968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab7968-4631-4bbf-9df4-aff173c2723d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:03.030839 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:03.040991 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:03.041964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:03.042379 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:03.042741 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:03.045538 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:03.173974 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:03.175471 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8890-603c-4927-b39e-a698111a3c9c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:03.194575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 738/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:05.199982 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:05.200540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:05.200540 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:05.201803 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:05.208207 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45bb8-db86-46c4-bef0-9ee75a269fbf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:05.208975 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45bb8-db86-46c4-bef0-9ee75a269fbf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:05.209150 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45bb8-db86-46c4-bef0-9ee75a269fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:05.279769 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4fc45bb8-db86-46c4-bef0-9ee75a269fbf None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:05.280979 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4fc45bb8-db86-46c4-bef0-9ee75a269fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:05.330366 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:05.384487 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:05.419934 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:05.421493 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:05.535426 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585713-b8db-4e95-9de5-7285db75e39f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:05.587732 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:05.621610 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:05.622282 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:05.622562 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:05.622834 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:05.624483 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:05.739767 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:05.741225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499324c9-dfb5-45e9-adc9-0124c51e686f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:05.760281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 731/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:15.382605 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=22 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:15.757871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=66 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:25.296037 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e84-21d7-4d75-9f2c-7d7904ad0337 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:25.296957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e84-21d7-4d75-9f2c-7d7904ad0337 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:25.296957 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e84-21d7-4d75-9f2c-7d7904ad0337 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:25.299367 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 740/1471] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:25.304753 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7456-ada9-401f-95b0-e282289811fb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:25.305225 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7456-ada9-401f-95b0-e282289811fb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:25.305320 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf7456-ada9-401f-95b0-e282289811fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:25.373941 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-addf7456-ada9-401f-95b0-e282289811fb None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:25.375276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-addf7456-ada9-401f-95b0-e282289811fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:25.474912 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 732/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:25.562105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:25.562543 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:25.562820 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:25.564213 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 741/1473] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 11 20:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:25.569477 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ac00-66ce-4066-842e-00ddb1f35938 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:25.569746 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ac00-66ce-4066-842e-00ddb1f35938 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:25.570028 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ac00-66ce-4066-842e-00ddb1f35938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:25.649509 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f1a6ac00-66ce-4066-842e-00ddb1f35938 None None] MFA Rules not processed for user `3e257ac3d850495e8c06e4c9cb01e29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:25.650769 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f1a6ac00-66ce-4066-842e-00ddb1f35938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:25.671530 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:25.727806 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 733/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 11 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:25.735850 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:25.738392 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:25.850691 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b7b5-c779-4552-b185-0c806b7c40af None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:25.927210 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e257ac3d850495e8c06e4c9cb01e29c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:25.927860 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:25.928142 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:25.928414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:25.930083 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:25.989863 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:26.047936 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:26.049420 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243b6b-0389-4276-8c34-703242653f9d service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:26.070632 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 742/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:28.180652 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:28.181199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:28.181199 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:28.182875 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 734/1476] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:28.188414 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a169b-3115-44e4-ba71-321d5ae774c9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:28.188869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a169b-3115-44e4-ba71-321d5ae774c9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:28.188977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a169b-3115-44e4-ba71-321d5ae774c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:28.255581 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ac2a169b-3115-44e4-ba71-321d5ae774c9 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:28.256786 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ac2a169b-3115-44e4-ba71-321d5ae774c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:28.366075 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 743/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:28.389915 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:28.391519 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:28.522590 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f11606-fb58-46e6-bafa-3a1eb6298e3c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:28.573168 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:28.622081 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:28.622761 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:28.623038 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:28.623276 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:28.624054 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:28.626285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:09:28.626285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jul 11 20:09:28.626285 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: Jul 11 20:09:28.630279 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71272619-c802-4d50-b465-a1a2ee526ce0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:28.658179 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 735/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 11 20:09:28 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:09:30.689840 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:30.690728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:30.690728 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:30.692928 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 744/1479] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:30.698547 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf75026-c08a-4f84-b93e-1aa25f4adbec None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:30.698993 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf75026-c08a-4f84-b93e-1aa25f4adbec None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:30.699146 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf75026-c08a-4f84-b93e-1aa25f4adbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:30.773907 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7bf75026-c08a-4f84-b93e-1aa25f4adbec None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:30.775704 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7bf75026-c08a-4f84-b93e-1aa25f4adbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:30.893497 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 736/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:30.940451 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:30.943048 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:30.956689 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:31.102450 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaa5f2-0e01-44e8-9d51-169232166c77 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:31.193964 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:31.228161 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d566879c44440bc4675b59c6d54e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:31.228824 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:31.229104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:31.229371 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:31.231071 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:31.328361 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:31.329153 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bd2e-cfb6-471c-a440-36ce00840088 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:31.348015 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 745/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:33.582194 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:33.583162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:33.583162 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:33.585408 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 737/1482] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:33.590793 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ee07-2568-4b88-9b6c-8f2cae48dc47 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:33.591212 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ee07-2568-4b88-9b6c-8f2cae48dc47 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:33.591307 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328ee07-2568-4b88-9b6c-8f2cae48dc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:33.663164 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f328ee07-2568-4b88-9b6c-8f2cae48dc47 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:33.664383 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f328ee07-2568-4b88-9b6c-8f2cae48dc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:33.713342 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:33.767107 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 746/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:33.803442 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:33.805041 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:33.830022 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:33.913502 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aef2f-72bd-459d-8f0d-7d9443233061 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:33.988503 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:33.989159 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:33.989441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:33.989721 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:33.991411 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:34.073269 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:34.110004 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:34.111489 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25064b-85e6-4ed9-b35d-31a42dd458d9 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:34.129592 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 738/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:36.220996 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:36.221586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:36.221586 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:36.222950 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 747/1485] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:36.229104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0ca4-6d3f-45ed-af34-22b6105da848 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:36.229572 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0ca4-6d3f-45ed-af34-22b6105da848 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:36.229681 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0ca4-6d3f-45ed-af34-22b6105da848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:36.312037 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7eba0ca4-6d3f-45ed-af34-22b6105da848 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:36.313331 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7eba0ca4-6d3f-45ed-af34-22b6105da848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:36.412873 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 739/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:36.450615 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:36.452179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:36.570375 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06917845-4f4d-4494-a3c3-a9d0adebbf57 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:36.645344 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:36.647977 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:36.648709 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:36.649109 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:36.649368 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:36.651623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:36.769655 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:36.771125 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96375a87-0f22-43b7-abb2-c1b752721238 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:36.789412 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 748/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:38.936983 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:38.937713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:38.937713 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:38.939105 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 740/1488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:38.944668 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2299d93-5aa8-4864-89b7-94283d2f6390 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:38.945117 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2299d93-5aa8-4864-89b7-94283d2f6390 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:38.945291 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2299d93-5aa8-4864-89b7-94283d2f6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:39.018508 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b2299d93-5aa8-4864-89b7-94283d2f6390 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:39.019742 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b2299d93-5aa8-4864-89b7-94283d2f6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:39.072394 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:39.125187 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 749/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:09:39.166213 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:39.168554 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:39.208822 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:39.285953 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1758a-f0a4-48b6-b159-c3ecbce8a85b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:39.361468 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:39.362227 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:39.362508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:39.362783 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:39.364441 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:39.461294 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:39.501400 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:39.502899 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c524e7-e500-4cb0-8b53-25f795fcaf1b service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:39.522139 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 741/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:41.797027 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:41.797638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:41.797638 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:41.799024 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 750/1491] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 11 20:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:09:41.804536 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7aad3-1366-4c0c-8632-6ab08c6c4fc6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:41.804954 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7aad3-1366-4c0c-8632-6ab08c6c4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:41.805073 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7aad3-1366-4c0c-8632-6ab08c6c4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:41.871752 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4ba7aad3-1366-4c0c-8632-6ab08c6c4fc6 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:09:41.872979 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4ba7aad3-1366-4c0c-8632-6ab08c6c4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:41.972431 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 742/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 11 20:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:09:42.011888 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:09:42.014298 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:42.138526 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00dda9-a1ca-473b-8ed1-0a09c23f0f45 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:09:42.211461 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:09:42.212112 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:09:42.212391 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:09:42.212656 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:09:42.214347 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:09:42.224448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:42.461179 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:09:42.462627 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c2daf-e85e-41e2-aa2a-6f3344adcb64 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:09:42.481869 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 751/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:09:51.970528 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=82 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:09:52.479272 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=50 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:10.632977 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:10.633605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:10.633605 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:10.716216 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:11:10.717660 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:10.825136 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 743/1494] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 11 20:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:11:10.833760 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:10.834248 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:10.834351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:10.916104 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:11:10.917321 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.031890 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 752/1495] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 11 20:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:11:11.036649 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.038019 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.049717 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fbdc6-41dc-4348-bb8d-b141e71d7d3e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:11.113601 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:11.148259 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:11.148910 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:11.149185 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:11.149452 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:11.150208 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:11:11.150508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:11.151525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:11.151525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jul 11 20:11:11.151525 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: Jul 11 20:11:11.152399 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:11.164553 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 744/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 11 20:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:11:11.172980 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.183105 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f502b5f-41c3-4a22-b62a-dfc5a8ed94be None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:11.249634 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:11.285978 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:11.286598 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:11.286876 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:11.287154 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:11.287864 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:11.289639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:11.289639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jul 11 20:11:11.289639 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: Jul 11 20:11:11.290894 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:11.348968 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 753/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 11 20:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:11:11.353306 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.355221 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.390296 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75073d2-2c44-47f0-aed3-9d17027b0a11 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:11.490638 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:11.491309 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:11.491589 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:11.491857 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:11.492563 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:11.493627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:11.493627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jul 11 20:11:11.493627 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: Jul 11 20:11:11.494869 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:11.547381 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 745/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 11 20:11:11 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:11:11.551923 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.553496 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.630381 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697353-babb-44d8-a185-978c9e181bdc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:11.717425 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:11.729833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:11.730548 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:11.730832 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:11.731108 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:11.731922 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:11.732955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:11.732955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jul 11 20:11:11.732955 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: Jul 11 20:11:11.733847 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:11.746737 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 754/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 11 20:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:11:11.751478 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.753835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.772347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3e93-f4c2-4669-8a29-7239cd7dc571 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:11.801950 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:11.877794 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:11.878508 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:11.878791 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:11.879068 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:11.879802 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:11.880835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:11.880835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jul 11 20:11:11.880835 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: Jul 11 20:11:11.881744 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a36c02-df0f-4829-89ed-491f8b2cedd2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:11.894344 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 746/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 11 20:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:11:11.898814 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:11.900351 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:11.935623 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868be0-b1db-4dde-8f05-36517f3918f7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:12.040087 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:12.040990 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.041279 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.041542 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] PATH_INFO: `/v3/projects/2cbfc5354ec34cba9d3ffdab3b14c49f/users/a3ea7cedb6924a25a3fdb0dbe84ca018/roles/034b96f9c53f43fe8c7be9cf9ad10bbe` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.065400 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbfc5354ec34cba9d3ffdab3b14c49f, user_id=a3ea7cedb6924a25a3fdb0dbe84ca018, role_id=034b96f9c53f43fe8c7be9cf9ad10bbe)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:12.066484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:12.066484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jul 11 20:11:12.066484 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: Jul 11 20:11:12.068431 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ce6c3-1933-42a9-a653-5bddd191ff37 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:12.096228 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 755/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 11 20:11:11 2022] PUT /identity/v3/projects/2cbfc5354ec34cba9d3ffdab3b14c49f/users/a3ea7cedb6924a25a3fdb0dbe84ca018/roles/034b96f9c53f43fe8c7be9cf9ad10bbe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:11:12.108781 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8392d-7520-4a4c-b9e7-d4346bff6dd8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.109071 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8392d-7520-4a4c-b9e7-d4346bff6dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.109366 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8392d-7520-4a4c-b9e7-d4346bff6dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.168597 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-49b8392d-7520-4a4c-b9e7-d4346bff6dd8 None None] MFA Rules not processed for user `a3ea7cedb6924a25a3fdb0dbe84ca018`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:11:12.169886 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-49b8392d-7520-4a4c-b9e7-d4346bff6dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:12.255435 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 747/1502] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 11 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:11:12.269003 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.269294 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.269575 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.271001 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 756/1503] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jul 11 20:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:11:12.275991 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553be-1796-4bc7-bfa5-563775c9b19c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.276281 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553be-1796-4bc7-bfa5-563775c9b19c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.276559 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553be-1796-4bc7-bfa5-563775c9b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.314655 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:12.367978 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-256553be-1796-4bc7-bfa5-563775c9b19c None None] MFA Rules not processed for user `d90591da6da54f888a3faf530b103888`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:11:12.369104 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-256553be-1796-4bc7-bfa5-563775c9b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:12.449625 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 748/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jul 11 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:11:12.457679 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:12.459281 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:12.511448 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:12.569813 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4644f79-fac1-41b4-a37e-d95e4f4eb516 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:12.653465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90591da6da54f888a3faf530b103888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:12.654550 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.654777 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.655139 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.656846 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:12.755465 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:12.756896 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:12.760402 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:12.779960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 757/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:11:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:11:12.822703 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfdfe-0f80-4db5-9e87-625582e0db5a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:12.823207 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfdfe-0f80-4db5-9e87-625582e0db5a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:12.823371 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfdfe-0f80-4db5-9e87-625582e0db5a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:12.824677 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 749/1506] 10.222.0.16 () {52 vars in 829 bytes} [Mon Jul 11 20:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:11:12.830531 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:12.831908 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:12.937747 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccfd0f-9f61-4fef-9754-b976568daba4 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:13.034806 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:13.035688 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:13.035972 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:13.036251 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] PATH_INFO: `/v3/users/a3ea7cedb6924a25a3fdb0dbe84ca018` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:13.049004 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ea7cedb6924a25a3fdb0dbe84ca018)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:13.050069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:13.050069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jul 11 20:11:13.050069 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: Jul 11 20:11:13.051322 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:13.061560 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:13.122833 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ea7cedb6924a25a3fdb0dbe84ca018'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:13.133306 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ea7cedb6924a25a3fdb0dbe84ca018'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:13.146960 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ea7cedb6924a25a3fdb0dbe84ca018'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:13.165233 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ea7cedb6924a25a3fdb0dbe84ca018'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:13.165686 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ea7cedb6924a25a3fdb0dbe84ca018'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:13.171845 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 758/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 11 20:11:12 2022] DELETE /identity/v3/users/a3ea7cedb6924a25a3fdb0dbe84ca018 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:11:13.176639 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:13.176924 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:13.177202 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:13.234635 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] MFA Rules not processed for user `e6037ad69919420ab0fb4e92ad544513`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:11:13.235838 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:13.315228 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:13.330384 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 750/1508] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 11 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:11:13.339843 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:13.341246 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:13.445506 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacecc2-7194-4d9c-99fc-a9518d6522bf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:13.501193 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:13.522949 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4f3e1239ec40daa85aec5e2825b161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd192a54da2a14b518a9c41a7af59f9bd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:13.523677 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:13.523944 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:13.524216 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:13.525911 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:13.638635 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:13.640084 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274411a-f7fe-471e-8314-55e67c515990 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:13.659680 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 759/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 11 20:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:11:14.032604 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:11:14.034063 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:11:14.045871 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a718-a27d-4049-b36a-801cdac44f82 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:11:14.145386 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6037ad69919420ab0fb4e92ad544513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baf222b77c1c4150a568d9f632f18818', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:11:14.146264 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:11:14.146574 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:11:14.146842 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] PATH_INFO: `/v3/projects/2cbfc5354ec34cba9d3ffdab3b14c49f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:11:14.157666 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbfc5354ec34cba9d3ffdab3b14c49f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:11:14.158754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 20:11:14.158754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jul 11 20:11:14.158754 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: Jul 11 20:11:14.159968 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:11:14.223788 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbfc5354ec34cba9d3ffdab3b14c49f', 'request_id': 'req-9cf49621-3d05-4d70-be86-8dcb5cd61934'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:14.234347 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbfc5354ec34cba9d3ffdab3b14c49f', 'request_id': 'req-9cf49621-3d05-4d70-be86-8dcb5cd61934'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:14.248025 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbfc5354ec34cba9d3ffdab3b14c49f', 'request_id': 'req-9cf49621-3d05-4d70-be86-8dcb5cd61934'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:14.271336 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] The token cache is being invalidate because project 2cbfc5354ec34cba9d3ffdab3b14c49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 20:11:14.271630 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:14.272066 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9cf49621-3d05-4d70-be86-8dcb5cd61934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 20:11:14.273515 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 751/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 11 20:11:14 2022] DELETE /identity/v3/projects/2cbfc5354ec34cba9d3ffdab3b14c49f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:11:23.657429 dv-cinder-849022-1-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=62 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:11:24.269351 dv-cinder-849022-1-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}